we are

2015-06-13 · writing

we are
yellow as sunlight on harvest hills
blue as darkness blacker than shadows
and in the rain
we hear choirs

Isoxya: free web crawler

Isoxya is a web crawler and data processing system, representing years of research into building a next-generation web crawler. It can process websites with tens of millions of pages, and extract and transform that data in myriad ways, including streaming data into Elasticsearch.