awesome-llama: https://github.com/ScrapeGraphAI/Scrapegraph-ai
ai-crawler ai-scraping ai-search crawler data-extraction firecrawl-alternative large-language-model llm markdown rag scraping scraping-python web-crawler web-crawlers web-data web-data-extraction web-scraper web-scraping web-search webscraping
Score: -Infinity
Last synced: about 20 hours ago
JSON representation
Repository metadata:
Python scraper based on AI
- Host: GitHub
- URL: https://github.com/ScrapeGraphAI/Scrapegraph-ai
- Owner: ScrapeGraphAI
- License: mit
- Created: 2024-01-27T16:54:38.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-07-20T14:22:20.000Z (24 days ago)
- Last Synced: 2026-08-07T03:48:10.354Z (7 days ago)
- Topics: ai-crawler, ai-scraping, ai-search, crawler, data-extraction, firecrawl-alternative, large-language-model, llm, markdown, rag, scraping, scraping-python, web-crawler, web-crawlers, web-data, web-data-extraction, web-scraper, web-scraping, web-search, webscraping
- Language: Python
- Homepage: https://scrapegraphai.com
- Size: 16.1 MB
- Stars: 29,163
- Watchers: 169
- Forks: 2,857
- Open Issues: 15
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Citation: citation.cff
- Security: SECURITY.md
-
Funding:
- Github: ScrapeGraphAI
- Open collective: scrapegraphai
Owner metadata:
- Name: ScrapeGraphAI
- Login: ScrapeGraphAI
- Email:
- Kind: organization
- Description:
- Website: https://scrapegraphai.com/
- Location: United States of America
- Twitter: scrapegraphai
- Company:
- Icon url: https://avatars.githubusercontent.com/u/171017415?v=4
- Repositories: 1
- Last Synced at: 2026-08-12T21:36:42.077Z
- Profile URL: https://github.com/ScrapeGraphAI
GitHub Events
Total
- Commit comment event: 51
- Create event: 165
- Delete event: 56
- Fork event: 585
- Issue comment event: 826
- Issues event: 212
- Pull request event: 211
- Pull request review comment event: 20
- Pull request review event: 50
- Push event: 457
- Release event: 104
- Watch event: 5670
- Total: 8407
Last Year
- Commit comment event: 51
- Create event: 165
- Delete event: 56
- Fork event: 585
- Issue comment event: 826
- Issues event: 212
- Pull request event: 211
- Pull request review comment event: 20
- Pull request review event: 50
- Push event: 457
- Release event: 104
- Watch event: 5670
- Total: 8407
Committers metadata
Last synced: 2 days ago
Total Commits: 2,149
Total Committers: 122
Avg Commits per committer: 17.615
Development Distribution Score (DDS): 0.569
Commits in past year: 108
Committers in past year: 19
Avg Commits per committer in past year: 5.684
Development Distribution Score (DDS) in past year: 0.611
| Name | Commits | |
|---|---|---|
| Marco Vinciguerra | m****1@g****m | 926 |
| semantic-release-bot | s****t@m****t | 456 |
| Marco Perini | p****8@g****m | 262 |
| Federico Aguzzi | 6****i | 84 |
| Matteo Vedovati | m****7@g****m | 53 |
| Lorenzo Padoan | l****7@g****m | 43 |
| codebeaver-ai[bot] | 1****] | 17 |
| roryhaung | r****1@g****m | 16 |
| copilot-swe-agent[bot] | 1****t | 15 |
| Eric Page | e****0@g****m | 14 |
| Lorenzo Paleari | 1****i | 13 |
| Federico Minutoli | f****i@r****t | 11 |
| Santabot123 | p****m@g****m | 10 |
| ekinsenler | e****r@g****m | 10 |
| Tejas Amol Hande | 5****e | 10 |
| smith peng | p****h@g****m | 9 |
| JGalego | j****0@g****m | 9 |
| aziz-ullah-khan | a****4@g****m | 8 |
| mayurdb | m****1@g****m | 8 |
| SwapnilSonker | s****2@g****m | 6 |
| DPende | p****e@g****m | 5 |
| Shubham Kamboj | s****j@s****i | 5 |
| CodeBeaver | i****o@c****i | 4 |
| Ikko Eltociear Ashimine | e****r@g****m | 4 |
| Stefan Krawczyk | s****n@d****o | 4 |
| Tom Robinson | t****n@g****m | 4 |
| Vikrant-Khedkar | v****0@g****m | 4 |
| dependabot[bot] | 4****] | 4 |
| ftoppi | f****i@g****m | 4 |
| Lrd | l****s@g****m | 4 |
| and 92 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 276
Total pull requests: 577
Average time to close issues: 25 days
Average time to close pull requests: 1 day
Total issue authors: 204
Total pull request authors: 83
Average comments per issue: 2.64
Average comments per pull request: 1.64
Merged pull request: 459
Bot issues: 0
Bot pull requests: 44
Past year issues: 17
Past year pull requests: 17
Past year average time to close issues: about 2 months
Past year average time to close pull requests: 3 days
Past year issue authors: 14
Past year pull request authors: 10
Past year average comments per issue: 0.94
Past year average comments per pull request: 0.18
Past year merged pull request: 2
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- VinciGit00 (16)
- anth0nyhak1m (6)
- nyck33 (6)
- f-aguzzi (5)
- aleenprd (4)
- LorenzoPaleari (4)
- silgon (4)
- Kilowhisky (4)
- matheus-rossi (3)
- DenisMarasescu (3)
- angelotc (3)
- rjbks (3)
- tm-robinson (3)
- salman-khandu (2)
- ekmekovski (2)
Top Pull Request Authors
- VinciGit00 (266)
- codebeaver-ai[bot] (42)
- f-aguzzi (35)
- PeriniM (25)
- LorenzoPaleari (18)
- aziz-ullah-khan (12)
- vedovati-matteo (12)
- ekinsenler (9)
- goasleep (7)
- shenghongtw (7)
- tm-robinson (6)
- SwapnilSonker (6)
- tuhinmallick (4)
- SamuelYiuSY (4)
- sandeepchittilla (4)
Top Issue Labels
- bug (41)
- question (13)
- released on @dev (12)
- feature request (10)
- enhancement (9)
- stale (9)
- documentation (4)
- released on @stable (4)
- dependencies (1)
- refactor (1)
- size:XL (1)
Top Pull Request Labels
- released on @stable (207)
- released on @dev (194)
- tests (54)
- size:M (34)
- size:L (31)
- bug (29)
- size:XS (20)
- lgtm (19)
- enhancement (18)
- dependencies (18)
- size:XL (16)
- size:S (15)
- documentation (13)
- size:XXL (11)
- typo (8)
- refactor (8)
Package metadata
- Total packages: 2
- Total downloads: unknown
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 930
proxy.golang.org: github.com/scrapegraphai/scrapegraph-ai
- Homepage:
- Documentation: https://pkg.go.dev/github.com/scrapegraphai/scrapegraph-ai#section-documentation
- Licenses: mit
- Latest release: v2.1.6+incompatible (published 24 days ago)
- Last Synced: 2026-08-11T22:04:07.430Z (2 days ago)
- Versions: 465
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.442%
- Average: 5.624%
- Dependent repos count: 5.807%
proxy.golang.org: github.com/ScrapeGraphAI/Scrapegraph-ai
- Homepage:
- Documentation: https://pkg.go.dev/github.com/ScrapeGraphAI/Scrapegraph-ai#section-documentation
- Licenses: mit
- Latest release: v2.1.6+incompatible (published 24 days ago)
- Last Synced: 2026-08-11T22:04:17.666Z (2 days ago)
- Versions: 465
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.442%
- Average: 5.624%
- Dependent repos count: 5.807%
Dependencies
- actions/checkout v4 composite
- github/codeql-action/init v3 composite
- actions/checkout v4 composite
- actions/dependency-review-action v4 composite
- pytest 8.0.0 develop
- sphinx 7.1.2 docs
- sphinx-rtd-theme 2.0.0 docs
- beautifulsoup4 4.12.3
- faiss-cpu 1.7.4
- graphviz 0.20.1
- html2text 2020.1.16
- langchain 0.1.6
- langchain_community 0.0.19
- langchain_core 0.1.22
- langchain_openai 0.0.5
- pandas 2.0.3
- python >3.9,<3.9.7 || >3.9.7,<3.12
- python-dotenv 1.0.1
- tiktoken >=0.5.2,<0.6.0
- tqdm 4.66.1
- trulens_eval 0.23.0
- actions/checkout v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v4 composite
- python 3.11-slim build
- actions/cache v3 composite
- actions/checkout v4.1.1 composite
- actions/setup-node v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v3 composite
- cycjimmy/semantic-release-action v4.1.0 composite
- ollama/ollama latest
- 227 dependencies