https://github.com/dotnetcore/DotnetSpider

crawler cross-platform csharp distributed dotnetcore

Score: 23.106575176513587

Last synced: about 3 hours ago
JSON representation

Repository metadata:

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Host: GitHub
URL: https://github.com/dotnetcore/DotnetSpider
Owner: dotnetcore
License: mit
Created: 2016-03-21T03:37:32.000Z (over 10 years ago)
Default Branch: master
Last Pushed: 2026-04-03T09:36:16.000Z (7 months ago)
Last Synced: 2026-10-27T10:36:46.712Z (7 days ago)
Topics: crawler, cross-platform, csharp, distributed, dotnetcore
Language: C#
Homepage:
Size: 56.3 MB
Stars: 4,142
Watchers: 251
Forks: 1,048
Open Issues: 6
Metadata Files:
- Readme: README.md
- License: LICENSE.txt

Owner metadata:

Name: .NET Core Community
Login: dotnetcore
Email: contact@ncc.work
Kind: organization
Description: An unofficial .NET open-source community born in China, contributing to the .NET ecosystem.
Website: https://www.dotnetcore.xyz
Location:
Twitter: ncc_community
Company:
Icon url: https://avatars.githubusercontent.com/u/19404084?v=4
Repositories: 37
Last Synced at: 2026-11-01T18:32:07.571Z
Profile URL: https://github.com/dotnetcore

GitHub Events

Total

Fork event: 34
Issue comment event: 7
Issues event: 6
Pull request event: 5
Push event: 1
Watch event: 159
Total: 212

Last Year

Fork event: 2
Pull request event: 1
Watch event: 10
Total: 13

Committers metadata

Last synced: 1 day ago

Total Commits: 123
Total Committers: 13
Avg Commits per committer: 9.462
Development Distribution Score (DDS): 0.187

Commits in past year: 2
Committers in past year: 1
Avg Commits per committer in past year: 2.0
Development Distribution Score (DDS) in past year: 0.0

Name	Email	Commits
邹嵩	z**r@1**m	100
Lewis Zou	s**u@p**m	6
ananck	3****k	3
GTXCK	h**7@l**m	3
包子	6**1@q**m	2
amin parsa	a**8@g**m	2
rangi376w	1****w	1
capad	w**6@1**m	1
TTonlyV5	5**0@q**m	1
Saleh Ahmadi	4****i	1
Jeff Ward	j**g@g**m	1
0x426c61636b486f6c65	v**o@g**m	1
shaoxiaoxu	s**u@a**n	1

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 93
Total pull requests: 37
Average time to close issues: 7 months
Average time to close pull requests: about 2 months
Total issue authors: 71
Total pull request authors: 23
Average comments per issue: 1.73
Average comments per pull request: 0.46
Merged pull request: 17
Bot issues: 0
Bot pull requests: 4

Past year issues: 0
Past year pull requests: 2
Past year average time to close issues: N/A
Past year average time to close pull requests: about 10 hours
Past year issue authors: 0
Past year pull request authors: 2
Past year average comments per issue: 0
Past year average comments per pull request: 0.0
Past year merged pull request: 1
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/dotnetcore/DotnetSpider

Top Issue Authors

alberthe (4)
Luudanhnhan1102 (3)
Sojaner (3)
sgf (3)
null-ed (3)
dflstone (2)
phungxuanvuong (2)
qiuliliang (2)
andrew2558 (2)
evanpeng-life (2)
a157147899 (2)
fayxue (2)
free12500540 (2)
shelley-xl (2)
lmxin123 (2)

Top Pull Request Authors

capadong (3)
zlzforever (3)
Sojaner (3)
dependabot[bot] (3)
a157147899 (2)
TTonlyV5 (2)
NugetNinja (2)
anassazeroual27 (2)
SalehAhmadi (2)
ananck (2)
renovate[bot] (1)
jeffward01 (1)
Velka-DEV (1)
yuanhuaming (1)
hjkl950217 (1)

Top Issue Labels

feature (2)
wontfix (1)
help wanted (1)
question (1)
bug (1)

Top Pull Request Labels

dependencies (3)
.NET (2)
javascript (1)

Package metadata

Total packages: 23
Total downloads:
- nuget: 200,996 total
Total dependent packages: 24 (may contain duplicates)
Total dependent repositories: 15 (may contain duplicates)
Total versions: 263
Total maintainers: 2

nuget.org: dotnetspider.extraction

A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET

Homepage: https://github.com/dotnetcore/DotnetSpider
Licenses: mit
Latest release: (published 1 day ago)
Last Synced: 2026-11-01T23:35:10.291Z (1 day ago)
Versions: 8
Dependent Packages: 4
Dependent Repositories: 3
Rankings:
- Forks count: 0.451%
- Stargazers count: 0.536%
- Average: 2.198%
- Dependent packages count: 3.627%
- Dependent repos count: 4.179%

nuget.org: dotnetspider.htmlagilitypack.css

A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET

Homepage: https://github.com/dotnetcore/DotnetSpider
Licenses: mit
Latest release: (published 1 day ago)
Last Synced: 2026-11-01T23:35:05.648Z (1 day ago)
Versions: 5
Dependent Packages: 5
Dependent Repositories: 2
Rankings:
- Forks count: 0.451%
- Stargazers count: 0.536%
- Average: 2.252%
- Dependent packages count: 2.893%
- Dependent repos count: 5.13%

nuget.org: dotnetspider.downloader

A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET

Homepage: https://github.com/dotnetcore/DotnetSpider
Licenses: mit
Latest release: (published 1 day ago)
Last Synced: 2026-11-01T23:34:46.046Z (1 day ago)
Versions: 6
Dependent Packages: 2
Dependent Repositories: 2
Rankings:
- Forks count: 0.451%
- Stargazers count: 0.536%
- Average: 3.235%
- Dependent repos count: 5.13%
- Dependent packages count: 6.823%

nuget.org: dotnetspider-private

this is a fork from DotnetSpider project,make some bug fixed for private use. DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Homepage: https://github.com/dotnetcore/DotnetSpider
Licenses: mit
Latest release: (published 1 day ago)
Last Synced: 2026-11-01T23:35:10.268Z (1 day ago)
Versions: 2
Dependent Packages: 1
Dependent Repositories: 1
Rankings:
- Forks count: 0.447%
- Stargazers count: 0.51%
- Average: 4.723%
- Dependent repos count: 7.01%
- Dependent packages count: 10.924%

nuget.org: dotnetspider.extension

A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET

Homepage: https://github.com/dotnetcore/DotnetSpider
Licenses: mit
Latest release: (published 1 day ago)
Last Synced: 2026-11-01T23:35:08.564Z (1 day ago)
Versions: 18
Dependent Packages: 0
Dependent Repositories: 6
Rankings:
- Forks count: 0.45%
- Stargazers count: 0.535%
- Dependent repos count: 2.922%
- Average: 6.156%
- Dependent packages count: 20.716%