Data

Tools

Indexes

Applications

Experiments

Summary

An open API service for producing an overview of a list of open source projects.

https://github.com/scrapy/w3lib

hacktoberfest python

Score: 27.450733448722186

Last synced: about 6 hours ago
JSON representation

Repository metadata:

Python library of web-related functions

Owner metadata:

GitHub Events

Total
Last Year

Committers metadata

Last synced: 1 day ago

Total Commits: 692
Total Committers: 60
Avg Commits per committer: 11.533
Development Distribution Score (DDS): 0.816

Commits in past year: 272
Committers in past year: 16
Avg Commits per committer in past year: 17.0
Development Distribution Score (DDS) in past year: 0.673

Name Email Commits
Adrián Chaves a****n@c****o 127
abebus a****3@g****m 96
Andrey Rakhmatullin w****r@w****e 94
Mikhail Korobov k****4@g****m 61
Paul Tremberth p****h@g****m 49
Kaif Khan k****f@b****m 48
Daniel Graña d****a@g****m 38
Lucy Wang w****7@g****m 18
Pablo Hoffman p****o@p****m 15
Artur Gaspar a****0@g****m 12
Eugenio Lacuesta e****a@g****m 12
Emmanuel Rondan e****n@p****n 10
Laerte Pereira l****k@g****m 9
Felipe Boff Nunes f****s@z****m 7
Sreekant Baheti 6****3 6
Nasir Hussain n****i@g****m 6
David Bengoa d****d@b****m 6
Alexander Sibiryakov s****e@y****u 5
Angeliki a****a@g****m 4
Shane Evans s****s@g****m 4
Νικόλαος-Διγενής Καραγιάννης d****l@g****m 4
Hugo van Kemenade h****k 4
tienvantranspk-tech 2****h 4
Aryan a****3@g****m 3
dependabot[bot] 4****] 3
koutoftimer k****r@g****m 3
preetwinder p****6@g****m 3
Artur Gaspar a****r@p****r 2
Dmitry Ippolitov i****7@g****m 2
Ed e****v@g****m 2
and 30 more...

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 68
Total pull requests: 353
Average time to close issues: over 1 year
Average time to close pull requests: 3 months
Total issue authors: 54
Total pull request authors: 89
Average comments per issue: 2.41
Average comments per pull request: 2.47
Merged pull request: 272
Bot issues: 0
Bot pull requests: 2

Past year issues: 7
Past year pull requests: 144
Past year average time to close issues: 4 days
Past year average time to close pull requests: 4 days
Past year issue authors: 6
Past year pull request authors: 37
Past year average comments per issue: 0.71
Past year average comments per pull request: 2.36
Past year merged pull request: 97
Past year bot issues: 0
Past year bot pull requests: 2

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/scrapy/w3lib

Top Issue Authors

  • kmike (5)
  • wRAR (4)
  • jvanasco (3)
  • Gallaecio (3)
  • stav (2)
  • andersk (2)
  • agammann (2)
  • htan2013 (1)
  • starrify (1)
  • itzzdev09 (1)
  • stummjr (1)
  • redapple (1)
  • rennerocha (1)
  • markbaas (1)
  • eeshsaxena (1)

Top Pull Request Authors

  • wRAR (65)
  • Gallaecio (39)
  • uchiha-bug-hunter (38)
  • AdrianAtZyte (33)
  • redapple (27)
  • kmike (21)
  • albertedwardson (6)
  • dangra (5)
  • dvdbng (5)
  • malloxpb (5)
  • hugovk (4)
  • Laerte (4)
  • abebus (3)
  • lucywang000 (3)
  • elacuesta (3)

Top Issue Labels

  • bug (21)
  • good first issue (7)
  • enhancement (7)
  • discuss (6)
  • CI (2)
  • docs (1)

Top Pull Request Labels

  • enhancement (15)
  • unattended (14)
  • CI (5)
  • github_actions (2)
  • dependencies (2)
  • spam (2)
  • docs (2)
  • bug (1)

Package metadata

pypi.org: w3lib

Library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Documentation: https://w3lib.readthedocs.io/en/latest/
  • Licenses: BSD-3-Clause
  • Latest release: 2.6.0 (published 2 days ago)
  • Last Synced: 2026-11-05T17:38:04.517Z (2 days ago)
  • Versions: 41
  • Dependent Packages: 75
  • Dependent Repositories: 10,580
  • Downloads: 6,968,404 Last month
  • Docker Downloads: 25,022,407
  • Rankings:
    • Dependent repos count: 0.087%
    • Downloads: 0.193%
    • Dependent packages count: 0.331%
    • Docker downloads count: 0.573%
    • Average: 1.491%
    • Stargazers count: 3.32%
    • Forks count: 4.441%
  • Maintainers (4)
proxy.golang.org: github.com/scrapy/w3lib

  • Homepage:
  • Documentation: https://pkg.go.dev/github.com/scrapy/w3lib#section-documentation
  • Licenses: bsd-3-clause
  • Latest release: v2.5.0+incompatible (published about 1 month ago)
  • Last Synced: 2026-11-06T01:13:45.141Z (1 day ago)
  • Versions: 33
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Forks count: 3.133%
    • Stargazers count: 3.854%
    • Average: 4.026%
    • Dependent packages count: 4.41%
    • Dependent repos count: 4.706%
alpine-edge: py3-w3lib

A library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.4.1-r0 (published 7 months ago)
  • Last Synced: 2026-08-21T11:36:45.463Z (3 months ago)
  • Versions: 9
  • Dependent Packages: 3
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 2.348%
    • Average: 7.098%
    • Forks count: 11.799%
    • Stargazers count: 14.245%
  • Maintainers (1)
alpine-edge: py3-w3lib-pyc

Precompiled Python bytecode for py3-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.4.1-r0 (published 7 months ago)
  • Last Synced: 2026-04-05T11:18:49.544Z (7 months ago)
  • Versions: 8
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Average: 10.213%
    • Forks count: 12.343%
    • Dependent packages count: 13.386%
    • Stargazers count: 15.123%
  • Maintainers (1)
conda-forge.org: w3lib

This is a Python library of web-related functions, such as remove comments, or tags from HTML snippets, extract base url from HTML snippets, translate entites on HTML strings, convert raw HTTP headers to dicts and vice-versa, construct HTTP auth header, converting HTML pages to unicode, sanitize urls (like browsers do), extract arguments from urls.

  • Homepage: https://github.com/scrapy/w3lib/
  • Licenses: BSD-3-Clause
  • Latest release: 1.22.0 (published over 6 years ago)
  • Last Synced: 2026-04-01T03:22:19.405Z (7 months ago)
  • Versions: 2
  • Dependent Packages: 12
  • Dependent Repositories: 23
  • Rankings:
    • Dependent packages count: 5.115%
    • Dependent repos count: 7.55%
    • Average: 12.66%
    • Forks count: 17.656%
    • Stargazers count: 20.32%
anaconda.org: w3lib

Python library of web-related functions such as extract base url from HTML snippets, translate entites on HTML strings, convert raw HTTP headers to dicts and vice-versa, construct HTTP auth header, converting HTML pages to unicode, etc.

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.3.1 (published 12 months ago)
  • Last Synced: 2026-03-27T15:09:30.550Z (7 months ago)
  • Versions: 6
  • Dependent Packages: 4
  • Dependent Repositories: 23
  • Downloads: 64,947 Total
  • Rankings:
    • Dependent packages count: 20.424%
    • Average: 28.843%
    • Forks count: 30.287%
    • Dependent repos count: 30.983%
    • Stargazers count: 33.676%
ubuntu-23.10: python-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: bsd-3-clause
  • Latest release: 2.1.2-1 (published 9 months ago)
  • Last Synced: 2026-03-14T01:17:23.063Z (8 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
alpine-v3.21: py3-w3lib-pyc

Precompiled Python bytecode for py3-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.2.1-r0 (published over 2 years ago)
  • Last Synced: 2026-04-01T01:45:07.775Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
alpine-v3.22: py3-w3lib

A library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.3.1-r0 (published almost 2 years ago)
  • Last Synced: 2026-04-01T01:56:02.610Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
guix: python-w3lib

Python library of web-related functions

alpine-v3.20: py3-w3lib

A library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.2.0-r0 (published over 2 years ago)
  • Last Synced: 2026-04-01T02:08:54.116Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
nixpkgs-unstable: python313Packages.w3lib

Library of web-related functions

alpine-v3.22: py3-w3lib-pyc

Precompiled Python bytecode for py3-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.3.1-r0 (published almost 2 years ago)
  • Last Synced: 2026-04-01T01:55:49.399Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
alpine-v3.20: py3-w3lib-pyc

Precompiled Python bytecode for py3-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.2.0-r0 (published over 2 years ago)
  • Last Synced: 2026-04-01T02:03:14.197Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
nixpkgs-unstable: python314Packages.w3lib

Library of web-related functions

ubuntu-24.04: python-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: bsd-3-clause
  • Latest release: 2.1.2-1.1 (published 9 months ago)
  • Last Synced: 2026-03-06T12:57:46.886Z (8 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
debian-13: python-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Documentation: https://packages.debian.org/trixie/python-w3lib
  • Licenses: bsd-3-clause
  • Latest release: 2.3.1-1 (published 9 months ago)
  • Last Synced: 2026-09-06T23:28:43.731Z (2 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
ubuntu-24.10: python-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: bsd-3-clause
  • Latest release: 2.2.1-1 (published 9 months ago)
  • Last Synced: 2026-03-09T14:21:51.698Z (8 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
alpine-v3.21: py3-w3lib

A library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.2.1-r0 (published over 2 years ago)
  • Last Synced: 2026-04-01T01:49:10.744Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
nixpkgs-23.11: python310Packages.w3lib

Library of web-related functions

nixpkgs-24.11: python312Packages.w3lib

Library of web-related functions

nixpkgs-24.05: python312Packages.w3lib

Library of web-related functions

nixpkgs-23.05: python311Packages.w3lib

Library of web-related functions

nixpkgs-23.11: python311Packages.w3lib

Library of web-related functions

alpine-v3.23: py3-w3lib-pyc

Precompiled Python bytecode for py3-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.3.1-r0 (published almost 2 years ago)
  • Last Synced: 2026-07-31T11:04:04.954Z (3 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)
nixpkgs-24.11: python311Packages.w3lib

Library of web-related functions

pkgsrc-netbsd-x86_64-10.1-all: www/py-w3lib

Python library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Documentation: https://pkgsrc.se/www/py-w3lib
  • Licenses: modified-bsd
  • Latest release: 2.4.0 (published 8 months ago)
  • Last Synced: 2026-05-27T10:50:57.278Z (5 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
nixpkgs-23.05: python310Packages.w3lib

Library of web-related functions

debian-12: python-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Documentation: https://packages.debian.org/bookworm/python-w3lib
  • Licenses: bsd-3-clause
  • Latest release: 2.1.1-1 (published 9 months ago)
  • Last Synced: 2026-03-13T08:36:44.863Z (8 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
ubuntu-23.04: python-w3lib

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: bsd-3-clause
  • Latest release: 2.1.1-1 (published 9 months ago)
  • Last Synced: 2026-03-11T06:07:59.849Z (8 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
nixpkgs-24.05: python311Packages.w3lib

Library of web-related functions

alpine-v3.23: py3-w3lib

A library of web-related functions

  • Homepage: https://github.com/scrapy/w3lib
  • Licenses: BSD-3-Clause
  • Latest release: 2.3.1-r0 (published almost 2 years ago)
  • Last Synced: 2026-04-09T12:05:31.119Z (7 months ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 0.0%
    • Dependent packages count: 0.0%
    • Average: 100%
  • Maintainers (1)

Dependencies

docs/requirements.txt pypi
  • sphinx *
  • sphinx-hoverxref *
  • sphinx-notfound-page *
  • sphinx_rtd_theme *
.github/workflows/build.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
.github/workflows/publish.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
.github/workflows/tests.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
setup.py pypi