nosql - aggregating profile feeds like facebook -


just wondering how guys feed aggregator simple facebook using nosql (like redis).

basically have many profiles, , each profiles have own feed. everytime user requests aggregate, system fetch these profiles, process them (and group them) , displays users. problem approach when has 1000 friends, system have fetch 1000 feeds (regardless if there's update or not) , process them.

how guys it?

obviously if can't updates in real time, need have done update before user asked - have list of known feeds , check updates on regular schedule, possibly based on update frequency of each feed. when user requests aggregate need return data have.

making sure data reasonably date bit trickier. if google can check entire internet every few minutes - not option people. however, can reasonably close real time combination of smart update scheduling , using real time apis available. similar working on basic architecture data store holding posts , number of processes can pull data particular type of feed , add posts data store in common format.


Comments

Popular posts from this blog

android - Spacing between the stars of a rating bar? -

aspxgridview - Devexpress grid - header filter does not work if column is initially hidden -

c# - How to execute a particular part of code asynchronously in a class -