http://www.seinit.org/privacy-projects/new-architecture-and-models Security & Privacy projects Sat, 06 Mar 2010 23:08:58 +0000 hourly 1 http://wordpress.org/?v=3.0 http://www.seinit.org/privacy-projects/new-architecture-and-models/comment-page-1#comment-57 Daniel Tunkelang Sat, 06 Mar 2010 22:29:39 +0000 http://seinit.org/?p=39#comment-57 I agree that it's silly to use a complex caching architecture when the main concern is i/o and everything can be fit into an in-memory index / database. My concern here is that some of LinkedIn's queries sounds CPU-intensive, or at least require lots of random access. I have over 400k degree-two connections, and I'm sure lots of people have more. Sounds like something you don't want to recompute on every query--but you do have to keep it somewhat up to date as the network changes. I agree that it’s silly to use a complex caching architecture when the main concern is i/o and everything can be fit into an in-memory index / database. My concern here is that some of LinkedIn’s queries sounds CPU-intensive, or at least require lots of random access. I have over 400k degree-two connections, and I’m sure lots of people have more. Sounds like something you don’t want to recompute on every query–but you do have to keep it somewhat up to date as the network changes.

]]>