you say

2012-06-19 · writing

you say
there are many ways to skin a cat
but I think
each sounds as cruel as the rest

Isoxya: free web crawler

Isoxya is a web crawler and data processing system, representing years of research into building a next-generation web crawler. It can process websites with tens of millions of pages, and extract and transform that data in myriad ways, including streaming data into Elasticsearch.