https://github.com/D4Vinci/Scrapling
ai ai-scraping automation crawler crawling crawling-python data data-extraction mcp mcp-server playwright python scraping selectors stealth web-scraper web-scraping web-scraping-python webscraping xpath
Score: 28.497476069099356
Last synced: about 23 hours ago
JSON representation
Repository metadata:
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
- Host: GitHub
- URL: https://github.com/D4Vinci/Scrapling
- Owner: D4Vinci
- License: bsd-3-clause
- Created: 2024-10-13T20:29:53.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2026-09-25T00:00:44.000Z (5 days ago)
- Last Synced: 2026-09-25T03:42:42.883Z (5 days ago)
- Topics: ai, ai-scraping, automation, crawler, crawling, crawling-python, data, data-extraction, mcp, mcp-server, playwright, python, scraping, selectors, stealth, web-scraper, web-scraping, web-scraping-python, webscraping, xpath
- Language: Python
- Homepage: https://scrapling.readthedocs.io/en/latest/
- Size: 10.1 MB
- Stars: 83,479
- Watchers: 308
- Forks: 8,533
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Roadmap: ROADMAP.md
-
Funding:
- Github: D4Vinci
- Buy me a coffee: d4vinci
- Ko fi: d4vinci
Owner metadata:
- Name: Karim shoair
- Login: D4Vinci
- Email:
- Kind: user
- Description: An extremely curious creature who loves to learn. A Computer Science and Information Security enthusiast. Web Scraping Expert.
- Website:
- Location: Egypt
- Twitter: D4Vinci1
- Company:
- Icon url: https://avatars.githubusercontent.com/u/20604835?u=09b7c5077ccfe08e9d863f07bfa60fa0168d0061&v=4
- Repositories: 17
- Last Synced at: 2026-09-27T22:43:08.045Z
- Profile URL: https://github.com/D4Vinci
Committers metadata
Last synced: 5 days ago
Total Commits: 1,398
Total Committers: 34
Avg Commits per committer: 41.118
Development Distribution Score (DDS): 0.054
Commits in past year: 681
Committers in past year: 31
Avg Commits per committer in past year: 21.968
Development Distribution Score (DDS) in past year: 0.101
| Name | Commits | |
|---|---|---|
| Karim shoair | D****i | 1323 |
| yetval | y****d@g****m | 14 |
| Abdullah | 5****6 | 9 |
| Matt Hillebrand | m****d@i****m | 4 |
| Yiğit ERDOĞAN | y****3@g****m | 4 |
| haosenwang1018 | 1****5@q****m | 4 |
| Andrew Barnes | a****s@g****m | 4 |
| d 🔹 | 2****d | 3 |
| mehmet turac | m****c@g****m | 3 |
| ImgBotApp | I****p@g****m | 2 |
| Mark Mayo | m****k@t****z | 2 |
| Mrityunjay SIngh | y****h@g****m | 2 |
| Salman Muin Kayser Chishti | 1****i@g****m | 2 |
| sjhddh | j****n@g****m | 2 |
| Amit Vijapur | v****t@g****m | 1 |
| Ahmed Elshahat | a****4@g****m | 1 |
| awanawona | 1 | |
| renbkna | n****z@h****m | 1 |
| karesansui | k****i@u****m | 1 |
| gk | g****3@n****m | 1 |
| andyfcx | d****y@g****m | 1 |
| Yehuda_LevS | 2****b | 1 |
| Semianchuk Vitalii | f****2@g****m | 1 |
| Robin Ede | r****e@t****u | 1 |
| RinZ27 | 2****7 | 1 |
| Rafael Gomides | m****s@g****m | 1 |
| OB | o****b@c****m | 1 |
| Mubashir Rahim | m****1@g****m | 1 |
| Jules Omlor | j****s@h****t | 1 |
| JanRK | j****k@i****k | 1 |
| and 4 more... | ||
Issue and Pull Request metadata
Last synced: 5 days ago
Total issues: 84
Total pull requests: 143
Average time to close issues: 10 days
Average time to close pull requests: 2 days
Total issue authors: 72
Total pull request authors: 52
Average comments per issue: 2.08
Average comments per pull request: 0.63
Merged pull request: 86
Bot issues: 0
Bot pull requests: 2
Past year issues: 51
Past year pull requests: 78
Past year average time to close issues: 7 days
Past year average time to close pull requests: 4 days
Past year issue authors: 45
Past year pull request authors: 45
Past year average comments per issue: 2.02
Past year average comments per pull request: 1.04
Past year merged pull request: 34
Past year bot issues: 0
Past year bot pull requests: 1
Top Issue Authors
- mrcolumbia (5)
- zenwav (3)
- freefish1218 (2)
- sxwebster (2)
- ZeroCode00 (2)
- sophieamoure2026-ui (2)
- postoso (2)
- tssoftwareprojects (2)
- subediparas5 (1)
- ttsoares (1)
- rawsun007 (1)
- chcodex (1)
- manja316 (1)
- mariojose96 (1)
- ibrahimmudassar (1)
Top Pull Request Authors
- D4Vinci (60)
- Yigtwxx (7)
- yetval (7)
- SulimanAbdulrazzaq (4)
- helgesander02 (4)
- Disaster-Terminator (3)
- AbuDhaabi (2)
- dwb-io (2)
- eltociear (2)
- mahtin (2)
- alkaz-nodemaven (2)
- AnandkumarMall (2)
- imgbot[bot] (2)
- Sanjays2402 (2)
- andyfcx (2)
Top Issue Labels
- bug (41)
- enhancement (21)
- Already Solved (16)
- invalid (9)
- dependency bug (4)
- mcp (3)
- Type hints (2)
- not planned (2)
- question (2)
- wontfix (1)
- AI-Slop (1)
- cloudflare (1)
- installation_bug (1)
- Python 3.14 issues (1)
- documentation (1)
Top Pull Request Labels
- Ready-to-Merge (8)
- bug (6)
- not planned (4)
- duplicate (4)
- dependency bug (4)
- AI-Slop (3)
- invalid (2)
- PR-against-rules (1)
- enhancement (1)
- Memory Optimizations (1)
- No-Impact (1)
- documentation (1)
Package metadata
- Total packages: 6
-
Total downloads:
- pypi: 837,960 last-month
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 202
- Total maintainers: 3
proxy.golang.org: github.com/D4Vinci/scrapling
- Homepage:
- Documentation: https://pkg.go.dev/github.com/D4Vinci/scrapling#section-documentation
- Licenses: bsd-3-clause
- Latest release: v0.4.15 (published about 1 month ago)
- Last Synced: 2026-09-25T03:47:05.020Z (5 days ago)
- Versions: 49
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.885%
- Average: 5.05%
- Dependent repos count: 5.214%
proxy.golang.org: github.com/D4Vinci/Scrapling
- Homepage:
- Documentation: https://pkg.go.dev/github.com/D4Vinci/Scrapling#section-documentation
- Licenses: bsd-3-clause
- Latest release: v0.4.15 (published about 1 month ago)
- Last Synced: 2026-09-25T03:47:04.749Z (5 days ago)
- Versions: 49
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.907%
- Average: 5.072%
- Dependent repos count: 5.237%
proxy.golang.org: github.com/d4vinci/scrapling
- Homepage:
- Documentation: https://pkg.go.dev/github.com/d4vinci/scrapling#section-documentation
- Licenses: bsd-3-clause
- Latest release: v0.4.15 (published about 1 month ago)
- Last Synced: 2026-09-25T03:47:04.753Z (5 days ago)
- Versions: 49
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.907%
- Average: 5.072%
- Dependent repos count: 5.237%
pypi.org: scrapling-zhng
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy again! In an internet filled with complications,
- Homepage: https://github.com/D4Vinci/Scrapling
- Documentation: https://scrapling.readthedocs.io/en/latest/
- Licenses: BSD
- Latest release: 0.2.99 (published about 1 year ago)
- Last Synced: 2026-09-25T03:47:03.527Z (5 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 4 Last month
-
Rankings:
- Stargazers count: 1.02%
- Forks count: 3.999%
- Dependent packages count: 8.855%
- Average: 15.942%
- Dependent repos count: 49.896%
- Maintainers (1)
pypi.org: iflow-mcp_d4vinci-scrapling
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy and effortless as it should be!
- Homepage: https://github.com/D4Vinci/Scrapling
- Documentation: https://scrapling.readthedocs.io/en/latest/
- Licenses: BSD License
- Latest release: 0.3.14 (published 8 months ago)
- Last Synced: 2026-09-25T03:47:04.621Z (5 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 11 Last month
-
Rankings:
- Dependent packages count: 7.872%
- Average: 26.328%
- Downloads: 26.606%
- Dependent repos count: 44.505%
- Maintainers (1)
pypi.org: scrapling
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy and effortless as it should be!
- Homepage: https://github.com/D4Vinci/Scrapling
- Documentation: https://scrapling.readthedocs.io/en/latest/
- Licenses: BSD License
- Latest release: 0.4.15 (published about 1 month ago)
- Last Synced: 2026-09-25T03:47:03.868Z (5 days ago)
- Versions: 53
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 837,945 Last month
-
Rankings:
- Dependent packages count: 10.205%
- Average: 33.819%
- Dependent repos count: 57.434%
- Maintainers (1)
Dependencies
- cssselect >=1.3.0
- lxml >=6.0.2
- orjson >=3.11.5
- tldextract >=5.3.1
- actions/checkout v4 composite
- docker/build-push-action v5 composite
- docker/login-action v3 composite
- docker/metadata-action v5 composite
- docker/setup-buildx-action v3 composite
- actions/checkout v4 composite
- actions/github-script v6 composite
- actions/setup-python v5 composite
- pypa/gh-action-pypi-publish release/v1 composite
- softprops/action-gh-release v1 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- python 3.12-slim-trixie build
- black >=25.12.0
- griffe-inherited-docstrings *
- griffe-runtime-objects *
- griffe-sphinx *
- mkdocs-material >=9.7.1
- mkdocstrings >=1.0.0
- mkdocstrings-python >=2.0.1
- pngquant *
- actions/checkout v4 composite
- actions/setup-python v5 composite
- pytest * test
- pytest-cov * test