http://blog.scalyr.com/2014/05/searching-20-gbsec-systems-engineering-before-algorithms/ ле tldr: Quite an interesting approach to search. Forget complex indexes, use brute force. Searching 20 GB/sec.