» A Comparison of Open Source Search Engines « zooie’s blog
So I proceeded to crawl Twitter to generate a sample data set. After about a full day and night, I had downloaded ~1M tweets (~10/second). But before indexing, I did some quick analysis of my…