awesome-llama: https://github.com/ScrapeGraphAI/Scrapegraph-ai
ai-crawler ai-scraping ai-search crawler data-extraction firecrawl-alternative large-language-model llm markdown rag scraping scraping-python web-crawler web-crawlers web-data web-data-extraction web-scraper web-scraping web-search webscraping
Score: -Infinity
Last synced: about 4 hours ago
JSON representation
Repository metadata:
Python scraper based on AI
- Host: GitHub
- URL: https://github.com/ScrapeGraphAI/Scrapegraph-ai
- Owner: ScrapeGraphAI
- License: mit
- Created: 2024-01-27T16:54:38.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2026-10-06T08:27:54.000Z (about 2 months ago)
- Last Synced: 2026-11-17T07:45:50.664Z (5 days ago)
- Topics: ai-crawler, ai-scraping, ai-search, crawler, data-extraction, firecrawl-alternative, large-language-model, llm, markdown, rag, scraping, scraping-python, web-crawler, web-crawlers, web-data, web-data-extraction, web-scraper, web-scraping, web-search, webscraping
- Language: Python
- Homepage: https://scrapegraphai.com
- Size: 16.5 MB
- Stars: 32,826
- Watchers: 179
- Forks: 3,352
- Open Issues: 34
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Citation: citation.cff
- Security: SECURITY.md
- Agents: AGENTS.md
-
Funding:
- Github: ScrapeGraphAI
- Open collective: scrapegraphai
Owner metadata:
- Name: ScrapeGraphAI
- Login: ScrapeGraphAI
- Email:
- Kind: organization
- Description:
- Website: https://scrapegraphai.com/
- Location: United States of America
- Twitter: scrapegraphai
- Company:
- Icon url: https://avatars.githubusercontent.com/u/171017415?v=4
- Repositories: 1
- Last Synced at: 2026-11-21T22:32:41.723Z
- Profile URL: https://github.com/ScrapeGraphAI
GitHub Events
Total
- Commit comment event: 52
- Create event: 166
- Delete event: 57
- Discussion event: 2
- Fork event: 691
- Issue comment event: 849
- Issues event: 232
- Pull request event: 247
- Pull request review comment event: 34
- Pull request review event: 58
- Push event: 510
- Release event: 108
- Watch event: 6591
- Total: 9597
Last Year
- Commit comment event: 1
- Create event: 1
- Delete event: 1
- Discussion event: 2
- Fork event: 126
- Issue comment event: 34
- Issues event: 23
- Pull request event: 36
- Pull request review comment event: 14
- Pull request review event: 8
- Push event: 53
- Release event: 4
- Watch event: 1066
- Total: 1369
Committers metadata
Last synced: 1 day ago
Total Commits: 2,198
Total Committers: 135
Avg Commits per committer: 16.281
Development Distribution Score (DDS): 0.576
Commits in past year: 144
Committers in past year: 30
Avg Commits per committer in past year: 4.8
Development Distribution Score (DDS) in past year: 0.667
| Name | Commits | |
|---|---|---|
| Marco Vinciguerra | m****1@g****m | 931 |
| semantic-release-bot | s****t@m****t | 480 |
| Marco Perini | p****8@g****m | 262 |
| Federico Aguzzi | 6****i | 84 |
| Matteo Vedovati | m****7@g****m | 53 |
| Lorenzo Padoan | l****7@g****m | 46 |
| codebeaver-ai[bot] | 1****] | 17 |
| roryhaung | r****1@g****m | 16 |
| copilot-swe-agent[bot] | 1****t | 15 |
| Eric Page | e****0@g****m | 14 |
| Lorenzo Paleari | 1****i | 13 |
| Federico Minutoli | f****i@r****t | 11 |
| Santabot123 | p****m@g****m | 10 |
| ekinsenler | e****r@g****m | 10 |
| Tejas Amol Hande | 5****e | 10 |
| smith peng | p****h@g****m | 9 |
| JGalego | j****0@g****m | 9 |
| aziz-ullah-khan | a****4@g****m | 8 |
| mayurdb | m****1@g****m | 8 |
| SwapnilSonker | s****2@g****m | 6 |
| DPende | p****e@g****m | 5 |
| Shubham Kamboj | s****j@s****i | 5 |
| CodeBeaver | i****o@c****i | 4 |
| Ikko Eltociear Ashimine | e****r@g****m | 4 |
| Stefan Krawczyk | s****n@d****o | 4 |
| Tom Robinson | t****n@g****m | 4 |
| Vikrant-Khedkar | v****0@g****m | 4 |
| aiapienthusiast | 3****t | 4 |
| dependabot[bot] | 4****] | 4 |
| ftoppi | f****i@g****m | 4 |
| and 105 more... | ||
Issue and Pull Request metadata
Last synced: 6 days ago
Total issues: 282
Total pull requests: 416
Average time to close issues: 25 days
Average time to close pull requests: 2 days
Total issue authors: 212
Total pull request authors: 119
Average comments per issue: 2.68
Average comments per pull request: 2.09
Merged pull request: 322
Bot issues: 0
Bot pull requests: 24
Past year issues: 16
Past year pull requests: 75
Past year average time to close issues: 19 days
Past year average time to close pull requests: 6 days
Past year issue authors: 14
Past year pull request authors: 46
Past year average comments per issue: 1.81
Past year average comments per pull request: 1.24
Past year merged pull request: 33
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- VinciGit00 (14)
- anth0nyhak1m (6)
- nyck33 (6)
- f-aguzzi (5)
- aleenprd (4)
- silgon (4)
- LorenzoPaleari (4)
- Kilowhisky (4)
- matheus-rossi (3)
- angelotc (3)
- DenisMarasescu (3)
- rjbks (3)
- justKishore (2)
- davideuler (2)
- lurenss (2)
Top Pull Request Authors
- VinciGit00 (179)
- codebeaver-ai[bot] (22)
- f-aguzzi (19)
- PeriniM (18)
- LorenzoPaleari (9)
- vedovati-matteo (7)
- ekinsenler (6)
- aziz-ullah-khan (6)
- lurenss (5)
- goasleep (4)
- shenghongtw (4)
- ghshhf (4)
- MohammadHijjawi97 (4)
- tm-robinson (4)
- SwapnilSonker (3)
Top Issue Labels
- bug (43)
- released on @dev (16)
- question (13)
- feature request (10)
- stale (9)
- released on @stable (8)
- enhancement (8)
- documentation (3)
- refactor (1)
- dependencies (1)
Top Pull Request Labels
- released on @stable (237)
- released on @dev (208)
- tests (41)
- bug (31)
- size:M (28)
- size:L (26)
- size:XS (23)
- enhancement (22)
- documentation (20)
- lgtm (18)
- size:S (15)
- dependencies (14)
- size:XL (10)
- size:XXL (9)
- refactor (8)
- typo (5)
Package metadata
- Total packages: 2
- Total downloads: unknown
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 960
proxy.golang.org: github.com/ScrapeGraphAI/Scrapegraph-ai
- Homepage:
- Documentation: https://pkg.go.dev/github.com/ScrapeGraphAI/Scrapegraph-ai#section-documentation
- Licenses: mit
- Latest release: v2.3.1+incompatible (published about 2 months ago)
- Last Synced: 2026-11-21T07:03:36.281819Z (1 day ago)
- Versions: 480
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.442%
- Average: 5.624%
- Dependent repos count: 5.807%
proxy.golang.org: github.com/scrapegraphai/scrapegraph-ai
- Homepage:
- Documentation: https://pkg.go.dev/github.com/scrapegraphai/scrapegraph-ai#section-documentation
- Licenses: mit
- Latest release: v2.3.1+incompatible (published about 2 months ago)
- Last Synced: 2026-11-21T07:03:36.610871Z (1 day ago)
- Versions: 480
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.442%
- Average: 5.624%
- Dependent repos count: 5.807%
Dependencies
- actions/checkout v4 composite
- github/codeql-action/init v3 composite
- actions/checkout v4 composite
- actions/dependency-review-action v4 composite
- pytest 8.0.0 develop
- sphinx 7.1.2 docs
- sphinx-rtd-theme 2.0.0 docs
- beautifulsoup4 4.12.3
- faiss-cpu 1.7.4
- graphviz 0.20.1
- html2text 2020.1.16
- langchain 0.1.6
- langchain_community 0.0.19
- langchain_core 0.1.22
- langchain_openai 0.0.5
- pandas 2.0.3
- python >3.9,<3.9.7 || >3.9.7,<3.12
- python-dotenv 1.0.1
- tiktoken >=0.5.2,<0.6.0
- tqdm 4.66.1
- trulens_eval 0.23.0
- actions/checkout v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v4 composite
- python 3.11-slim build
- actions/cache v3 composite
- actions/checkout v4.1.1 composite
- actions/setup-node v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v3 composite
- cycjimmy/semantic-release-action v4.1.0 composite
- ollama/ollama latest
- 227 dependencies