@harrisj @kjhealy Sure, but it's INCREDIBLY hard to bootstrap your own crawlers of any complexity without like installing Hadoop first.