awesome-llama: https://github.com/ScrapeGraphAI/Scrapegraph-ai
ai-crawler ai-scraping ai-search crawler data-extraction firecrawl-alternative large-language-model llm markdown rag scraping scraping-python web-crawler web-crawlers web-data web-data-extraction web-scraper web-scraping web-search webscraping
Score: -Infinity
Last synced: about 9 hours ago
JSON representation
Repository metadata:
Python scraper based on AI
- Host: GitHub
- URL: https://github.com/ScrapeGraphAI/Scrapegraph-ai
- Owner: ScrapeGraphAI
- License: mit
- Created: 2024-01-27T16:54:38.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-09-25T14:26:28.000Z (8 days ago)
- Last Synced: 2026-09-27T16:40:55.565Z (5 days ago)
- Topics: ai-crawler, ai-scraping, ai-search, crawler, data-extraction, firecrawl-alternative, large-language-model, llm, markdown, rag, scraping, scraping-python, web-crawler, web-crawlers, web-data, web-data-extraction, web-scraper, web-scraping, web-search, webscraping
- Language: Python
- Homepage: https://scrapegraphai.com
- Size: 16.5 MB
- Stars: 31,354
- Watchers: 178
- Forks: 3,162
- Open Issues: 17
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Citation: citation.cff
- Security: SECURITY.md
- Agents: AGENTS.md
-
Funding:
- Github: ScrapeGraphAI
- Open collective: scrapegraphai
Owner metadata:
- Name: ScrapeGraphAI
- Login: ScrapeGraphAI
- Email:
- Kind: organization
- Description:
- Website: https://scrapegraphai.com/
- Location: United States of America
- Twitter: scrapegraphai
- Company:
- Icon url: https://avatars.githubusercontent.com/u/171017415?v=4
- Repositories: 1
- Last Synced at: 2026-10-02T02:03:24.170Z
- Profile URL: https://github.com/ScrapeGraphAI
GitHub Events
Total
- Commit comment event: 52
- Create event: 166
- Delete event: 57
- Discussion event: 2
- Fork event: 691
- Issue comment event: 849
- Issues event: 232
- Pull request event: 247
- Pull request review comment event: 34
- Pull request review event: 58
- Push event: 510
- Release event: 108
- Watch event: 6591
- Total: 9597
Last Year
- Commit comment event: 1
- Create event: 1
- Delete event: 1
- Discussion event: 2
- Fork event: 126
- Issue comment event: 34
- Issues event: 23
- Pull request event: 36
- Pull request review comment event: 14
- Pull request review event: 8
- Push event: 53
- Release event: 4
- Watch event: 1066
- Total: 1369
Committers metadata
Last synced: 1 day ago
Total Commits: 2,196
Total Committers: 134
Avg Commits per committer: 16.388
Development Distribution Score (DDS): 0.576
Commits in past year: 152
Committers in past year: 31
Avg Commits per committer in past year: 4.903
Development Distribution Score (DDS) in past year: 0.671
| Name | Commits | |
|---|---|---|
| Marco Vinciguerra | m****1@g****m | 931 |
| semantic-release-bot | s****t@m****t | 479 |
| Marco Perini | p****8@g****m | 262 |
| Federico Aguzzi | 6****i | 84 |
| Matteo Vedovati | m****7@g****m | 53 |
| Lorenzo Padoan | l****7@g****m | 46 |
| codebeaver-ai[bot] | 1****] | 17 |
| roryhaung | r****1@g****m | 16 |
| copilot-swe-agent[bot] | 1****t | 15 |
| Eric Page | e****0@g****m | 14 |
| Lorenzo Paleari | 1****i | 13 |
| Federico Minutoli | f****i@r****t | 11 |
| Santabot123 | p****m@g****m | 10 |
| ekinsenler | e****r@g****m | 10 |
| Tejas Amol Hande | 5****e | 10 |
| smith peng | p****h@g****m | 9 |
| JGalego | j****0@g****m | 9 |
| aziz-ullah-khan | a****4@g****m | 8 |
| mayurdb | m****1@g****m | 8 |
| SwapnilSonker | s****2@g****m | 6 |
| DPende | p****e@g****m | 5 |
| Shubham Kamboj | s****j@s****i | 5 |
| CodeBeaver | i****o@c****i | 4 |
| Ikko Eltociear Ashimine | e****r@g****m | 4 |
| Stefan Krawczyk | s****n@d****o | 4 |
| Tom Robinson | t****n@g****m | 4 |
| Vikrant-Khedkar | v****0@g****m | 4 |
| aiapienthusiast | 3****t | 4 |
| dependabot[bot] | 4****] | 4 |
| ftoppi | f****i@g****m | 4 |
| and 104 more... | ||
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 282
Total pull requests: 622
Average time to close issues: 25 days
Average time to close pull requests: 1 day
Total issue authors: 210
Total pull request authors: 107
Average comments per issue: 2.68
Average comments per pull request: 1.66
Merged pull request: 489
Bot issues: 0
Bot pull requests: 44
Past year issues: 21
Past year pull requests: 62
Past year average time to close issues: 25 days
Past year average time to close pull requests: 4 days
Past year issue authors: 19
Past year pull request authors: 35
Past year average comments per issue: 1.81
Past year average comments per pull request: 1.42
Past year merged pull request: 32
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- VinciGit00 (16)
- anth0nyhak1m (6)
- nyck33 (6)
- f-aguzzi (5)
- aleenprd (4)
- LorenzoPaleari (4)
- Kilowhisky (4)
- silgon (4)
- angelotc (3)
- DenisMarasescu (3)
- matheus-rossi (3)
- rjbks (3)
- tm-robinson (3)
- ekmekovski (2)
- salman-khandu (2)
Top Pull Request Authors
- VinciGit00 (280)
- codebeaver-ai[bot] (42)
- f-aguzzi (35)
- PeriniM (25)
- LorenzoPaleari (18)
- aziz-ullah-khan (12)
- vedovati-matteo (12)
- ekinsenler (9)
- goasleep (7)
- shenghongtw (7)
- SwapnilSonker (6)
- tm-robinson (6)
- lurenss (5)
- sandeepchittilla (4)
- SamuelYiuSY (4)
Top Issue Labels
- bug (43)
- released on @dev (16)
- question (13)
- feature request (10)
- enhancement (9)
- stale (9)
- released on @stable (8)
- documentation (4)
- dependencies (1)
- refactor (1)
- size:XL (1)
Top Pull Request Labels
- released on @stable (236)
- released on @dev (218)
- tests (62)
- size:M (41)
- bug (39)
- size:L (38)
- size:XS (31)
- lgtm (25)
- enhancement (25)
- documentation (23)
- dependencies (19)
- size:S (18)
- size:XL (17)
- size:XXL (13)
- refactor (9)
- typo (8)
Package metadata
- Total packages: 2
- Total downloads: unknown
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 958
proxy.golang.org: github.com/ScrapeGraphAI/Scrapegraph-ai
- Homepage:
- Documentation: https://pkg.go.dev/github.com/ScrapeGraphAI/Scrapegraph-ai#section-documentation
- Licenses: mit
- Latest release: v2.3.0+incompatible (published 8 days ago)
- Last Synced: 2026-10-01T17:44:15.152Z (1 day ago)
- Versions: 479
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.442%
- Average: 5.624%
- Dependent repos count: 5.807%
proxy.golang.org: github.com/scrapegraphai/scrapegraph-ai
- Homepage:
- Documentation: https://pkg.go.dev/github.com/scrapegraphai/scrapegraph-ai#section-documentation
- Licenses: mit
- Latest release: v2.3.0+incompatible (published 8 days ago)
- Last Synced: 2026-10-01T17:43:50.354Z (1 day ago)
- Versions: 479
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.442%
- Average: 5.624%
- Dependent repos count: 5.807%
Dependencies
- actions/checkout v4 composite
- github/codeql-action/init v3 composite
- actions/checkout v4 composite
- actions/dependency-review-action v4 composite
- pytest 8.0.0 develop
- sphinx 7.1.2 docs
- sphinx-rtd-theme 2.0.0 docs
- beautifulsoup4 4.12.3
- faiss-cpu 1.7.4
- graphviz 0.20.1
- html2text 2020.1.16
- langchain 0.1.6
- langchain_community 0.0.19
- langchain_core 0.1.22
- langchain_openai 0.0.5
- pandas 2.0.3
- python >3.9,<3.9.7 || >3.9.7,<3.12
- python-dotenv 1.0.1
- tiktoken >=0.5.2,<0.6.0
- tqdm 4.66.1
- trulens_eval 0.23.0
- actions/checkout v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v4 composite
- python 3.11-slim build
- actions/cache v3 composite
- actions/checkout v4.1.1 composite
- actions/setup-node v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v3 composite
- cycjimmy/semantic-release-action v4.1.0 composite
- ollama/ollama latest
- 227 dependencies