Crawler Commons
A set of reusable Java components that implement functionality common to any web crawler
Overview
Crawler-Commons is a set of reusable Java components that implement functionality common to any web crawler. It benefits from collaboration among various existing web crawler projects and helps reduce duplication of effort.
Features
- Reusable Java components
- Implements functionality common to any web crawler
- Benefits from collaboration with other web crawler projects
- Reduces duplication of effort
Summary
Crawler-Commons is a set of reusable Java components for web crawling. It implements functionality common to any web crawler and benefits from collaboration with other web crawler projects. The installation process is straightforward using either Maven or Gradle. Overall, Crawler-Commons is a useful tool for developers looking to implement web crawling functionality in their Java applications.