# Web data collection

Canonical: https://openpick.ing/p/web-scraping
As of: 2026-11-15 10:00 UTC


The most used open source project in the Web data collection category is ripienaar/free-for-dev \(142,883 stars\), followed by NanmiCoder/MediaCrawler and KeygraphHQ/shannon. There is no 30 day star data yet, so growth is not ranked \(data as of 2026-11-15\).

## Most used
- [ripienaar/free-for-dev](https://openpick.ing/r/free-for-dev), 142,883 stars
- [NanmiCoder/MediaCrawler](https://openpick.ing/r/mediacrawler), 71,136 stars
- [KeygraphHQ/shannon](https://openpick.ing/r/shannon), 51,911 stars

## Tools for this problem
- [ripienaar/free-for-dev](https://openpick.ing/r/free-for-dev), license: No license listed: Check the license, maintenance: Active
- [NanmiCoder/MediaCrawler](https://openpick.ing/r/mediacrawler), license: Custom license: Check the license, maintenance: Active
- [KeygraphHQ/shannon](https://openpick.ing/r/shannon), license: AGPL-3.0: Yes, with conditions, maintenance: Active
- [NaiboWang/EasySpider](https://openpick.ing/r/easyspider), license: AGPL-3.0: Yes, with conditions, maintenance: Active
- [Usagi-org/ai-goofish-monitor](https://openpick.ing/r/ai-goofish-monitor), license: MIT: Yes, maintenance: Active

Not legal advice