thunder cracks

2015-07-23 · writing

thunder cracks
electrified landscape, laying bare
all we were and wished to be
still no rain
perhaps tomorrow

Isoxya: free web crawler

Isoxya is a web crawler and data processing system, representing years of research into building a next-generation web crawler. It can process websites with tens of millions of pages, and extract and transform that data in myriad ways, including streaming data into Elasticsearch.