in bright sunlight

2014-06-09 · writing

in bright sunlight
long shadows
stretch
to smaller shadows
dark to dark
light from light

Isoxya: free web crawler

Isoxya is a web crawler and data processing system, representing years of research into building a next-generation web crawler. It can process websites with tens of millions of pages, and extract and transform that data in myriad ways, including streaming data into Elasticsearch.