Depth-controlled crawling
Start with a URL and let dasyu discover linked pages up to a configurable crawl depth. Control how far exploration goes, restrict crawling to the starting origin or allow external destinations when required.
- +Breadth-first search crawling.
- +Configurable depth from 1 to 5.
- +URL normalization and deduplication.
- +Same-origin filtering.
- +Configurable concurrency.