https://github.com/scrapy/queuelib

hacktoberfest non-persistent persistent python python3 queues

Score: 25.289629293278228

Last synced: about 15 hours ago
JSON representation

Repository metadata:

Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python

Host: GitHub
URL: https://github.com/scrapy/queuelib
Owner: scrapy
License: bsd-3-clause
Created: 2013-04-23T17:51:41.000Z (over 13 years ago)
Default Branch: master
Last Pushed: 2026-10-19T08:54:28.000Z (16 days ago)
Last Synced: 2026-10-22T15:17:05.482Z (12 days ago)
Topics: hacktoberfest, non-persistent, persistent, python, python3, queues
Language: Python
Homepage:
Size: 196 KB
Stars: 300
Watchers: 18
Forks: 58
Open Issues: 0
Metadata Files:
- Readme: README.rst
- Changelog: NEWS
- License: LICENSE

Owner metadata:

Name: Scrapy project
Login: scrapy
Email:
Kind: organization
Description: An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.
Website: https://scrapy.org
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/733635?v=4
Repositories: 35
Last Synced at: 2026-10-30T06:33:24.586Z
Profile URL: https://github.com/scrapy

GitHub Events

Total

Create event: 7
Delete event: 8
Issue comment event: 8
Issues event: 1
Pull request event: 16
Pull request review comment event: 2
Pull request review event: 6
Push event: 16
Release event: 1
Watch event: 21
Total: 86

Last Year

Create event: 1
Delete event: 2
Issue comment event: 2
Pull request event: 3
Pull request review comment event: 1
Push event: 2
Watch event: 6
Total: 17

Committers metadata

Last synced: 2 days ago

Total Commits: 144
Total Committers: 15
Avg Commits per committer: 9.6
Development Distribution Score (DDS): 0.75

Commits in past year: 20
Committers in past year: 5
Avg Commits per committer in past year: 4.0
Development Distribution Score (DDS) in past year: 0.55

Name	Email	Commits
Eugenio Lacuesta	e**a@g**m	36
Andrey Rakhmatullin	w**r@w**e	35
Daniel Graña	d**a@g**m	32
Adrián Chaves	a**n@c**o	17
Tianhui Michael Li	t**l@c**u	7
Emmanuel Rondan	e**n@p**n	5
foresightyj	i**n@g**m	2
Pablo Hoffman	p**o@p**m	2
Marc Hernandez Cabot	n**i@g**m	2
dependabot[bot]	4****]	1
Vitaliy	V**o@g**m	1
Shubham Padkonde	s**2@g**m	1
Laerte Pereira	5****e	1
Klaus Alexander Seistrup	k****p	1
Dimitrios Kouzis-Loukas	l**d@g**m	1

Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 21
Total pull requests: 86
Average time to close issues: over 1 year
Average time to close pull requests: 5 months
Total issue authors: 19
Total pull request authors: 23
Average comments per issue: 2.9
Average comments per pull request: 1.52
Merged pull request: 72
Bot issues: 0
Bot pull requests: 2

Past year issues: 2
Past year pull requests: 19
Past year average time to close issues: 3 months
Past year average time to close pull requests: 7 days
Past year issue authors: 2
Past year pull request authors: 7
Past year average comments per issue: 0.5
Past year average comments per pull request: 0.89
Past year merged pull request: 16
Past year bot issues: 0
Past year bot pull requests: 2

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/scrapy/queuelib

Top Issue Authors

ghost (2)
Gallaecio (2)
base698 (1)
kmike (1)
wRAR (1)
ChristianTheConsultant (1)
foresightyj (1)
ArturGaspar (1)
obeleh (1)
heroesm (1)
nramirezuy (1)
peter-wangxu (1)
etayluz (1)
nikita1610 (1)
DavidDr90 (1)

Top Pull Request Authors

wRAR (29)
elacuesta (17)
Gallaecio (9)
AdrianAtZyte (6)
dangra (3)
emarondan (2)
hamedsh (2)
tianhuil (2)
dependabot[bot] (2)
base698 (1)
nagesh4193 (1)
Laerte (1)
lookfwd (1)
kseistrup (1)
santhreal (1)

Top Issue Labels

bug (4)
enhancement (2)
question (1)
duplicate (1)
discuss (1)

Top Pull Request Labels

enhancement (6)
github_actions (2)
dependencies (2)
spam (1)

Package metadata

Total packages: 27
Total downloads:
- conda: 346,147 total
- pypi: 2,310,110 last-month
Total docker downloads: 18,711,114
Total dependent packages: 15 (may contain duplicates)
Total dependent repositories: 8,407 (may contain duplicates)
Total versions: 62
Total maintainers: 5

nixpkgs-unstable: python313Packages.queuelib

Collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/queuelib/default.nix#L26
Licenses: BSD-3-Clause
Latest release: 1.10.0 (published 3 days ago)
Last Synced: 2026-11-01T11:10:53.284Z (3 days ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 1.091%
- Forks count: 1.962%
- Stargazers count: 2.403%

pypi.org: queuelib

Collection of persistent (disk-based) and non-persistent (memory-based) queues

Homepage: https://github.com/scrapy/queuelib
Documentation: https://queuelib.readthedocs.io/
Licenses: BSD-3-Clause
Latest release: 1.10.0 (published 2 months ago)
Last Synced: 2026-11-02T02:08:21.144Z (2 days ago)
Versions: 17
Dependent Packages: 8
Dependent Repositories: 8,361
Downloads: 2,310,110 Last month
Docker Downloads: 18,711,114
Rankings:
- Dependent repos count: 0.099%
- Downloads: 0.303%
- Docker downloads count: 0.615%
- Dependent packages count: 1.384%
- Average: 2.02%
- Stargazers count: 4.031%
- Forks count: 5.687%
Maintainers (4)
- dangra
- kmike
- pablohoffman
- scrapy

alpine-edge: py3-queuelib

A collection of persistent (disk-based) queues

Homepage: https://github.com/scrapy/queuelib
Licenses: BSD-3-Clause
Latest release: 1.8.0-r1 (published 7 months ago)
Last Synced: 2026-04-02T15:28:33.101Z (7 months ago)
Versions: 7
Dependent Packages: 1
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 6.031%
- Average: 9.582%
- Forks count: 15.928%
- Stargazers count: 16.371%
Maintainers (1)
- fabian@affolter-engineering.ch

alpine-edge: py3-queuelib-pyc

Precompiled Python bytecode for py3-queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: BSD-3-Clause
Latest release: 1.8.0-r1 (published 7 months ago)
Last Synced: 2026-04-02T15:28:13.126Z (7 months ago)
Versions: 6
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Average: 11.972%
- Dependent packages count: 13.386%
- Forks count: 17.184%
- Stargazers count: 17.316%
Maintainers (1)
- fabian@affolter-engineering.ch

ubuntu-24.04: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: bsd-3-clause
Latest release: 1.6.2-2 (published 9 months ago)
Last Synced: 2026-10-15T11:30:34.174Z (19 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Stargazers count: 14.033%
- Average: 14.228%
- Forks count: 14.424%

conda-forge.org: queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: BSD-3-Clause
Latest release: 1.6.2 (published about 5 years ago)
Last Synced: 2026-09-01T11:31:35.709Z (2 months ago)
Versions: 3
Dependent Packages: 4
Dependent Repositories: 23
Downloads: 300,821 Total
Rankings:
- Dependent repos count: 7.55%
- Dependent packages count: 12.496%
- Average: 17.306%
- Stargazers count: 24.313%
- Forks count: 24.867%

anaconda.org: queuelib

Queuelib goals are speed and simplicity.

Homepage: https://github.com/scrapy/queuelib
Licenses: BSD-3-Clause
Latest release: 1.8.0 (published 12 months ago)
Last Synced: 2026-07-28T05:02:38.744Z (3 months ago)
Versions: 3
Dependent Packages: 2
Dependent Repositories: 23
Downloads: 45,326 Total
Rankings:
- Dependent packages count: 20.474%
- Dependent repos count: 30.772%
- Average: 31.364%
- Stargazers count: 36.634%
- Forks count: 37.576%

nixpkgs-unstable: python314Packages.queuelib

Collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/queuelib/default.nix#L26
Licenses: BSD-3-Clause
Latest release: 1.10.0 (published 2 days ago)
Last Synced: 2026-11-01T11:45:09.949Z (2 days ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-23.11: python310Packages.queuelib

A collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/python-modules/queuelib/default.nix#L19
Licenses: BSD-3-Clause
Latest release: 1.6.2 (published 9 months ago)
Last Synced: 2026-03-07T08:35:13.463Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:

nixpkgs-24.11: python312Packages.queuelib

Collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/queuelib/default.nix#L21
Licenses: BSD-3-Clause
Latest release: 1.7.0 (published 9 months ago)
Last Synced: 2026-03-06T06:37:53.062Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:

debian-13: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Documentation: https://packages.debian.org/trixie/python-queuelib
Licenses: bsd-3-clause
Latest release: 1.8.0-1 (published 9 months ago)
Last Synced: 2026-08-05T21:04:10.698Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

ubuntu-20.04: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: bsd-3-clause
Latest release: 1.5.0-1 (published 9 months ago)
Last Synced: 2026-03-13T12:25:36.284Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-23.11: python311Packages.queuelib

A collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/python-modules/queuelib/default.nix#L19
Licenses: BSD-3-Clause
Latest release: 1.6.2 (published 9 months ago)
Last Synced: 2026-03-08T11:43:33.261Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-24.05: python312Packages.queuelib

A collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/queuelib/default.nix#L21
Licenses: BSD-3-Clause
Latest release: 1.7.0 (published 9 months ago)
Last Synced: 2026-07-25T11:00:15.013Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

debian-10: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Documentation: https://packages.debian.org/buster/python-queuelib
Licenses: bsd-3-clause
Latest release: 1.4.2-1 (published 9 months ago)
Last Synced: 2026-03-13T16:06:10.161Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

ubuntu-22.04: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: bsd-3-clause
Latest release: 1.6.2-1 (published 9 months ago)
Last Synced: 2026-08-19T12:31:49.659Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

debian-11: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Documentation: https://packages.debian.org/bullseye/python-queuelib
Licenses: bsd-3-clause
Latest release: 1.5.0-1 (published 9 months ago)
Last Synced: 2026-03-14T04:19:32.092Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

debian-12: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Documentation: https://packages.debian.org/bookworm/python-queuelib
Licenses: bsd-3-clause
Latest release: 1.6.2-2 (published 9 months ago)
Last Synced: 2026-08-31T04:29:15.456Z (2 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

ubuntu-23.04: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: bsd-3-clause
Latest release: 1.6.2-2 (published 9 months ago)
Last Synced: 2026-03-11T13:29:44.114Z (8 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

ubuntu-24.10: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Status: removed
Licenses: bsd-3-clause
Latest release: 1.7.0-1 (published 9 months ago)
Last Synced: 2026-07-30T04:03:25.634Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-23.05: python311Packages.queuelib

A collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.05/pkgs/development/python-modules/queuelib/default.nix#L19
Licenses: BSD-3-Clause
Latest release: 1.6.2 (published 9 months ago)
Last Synced: 2026-04-14T21:09:36.256Z (7 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

guix: python-queuelib

Collection of queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/python-xyz.scm#n34672
Licenses: bsd-3
Latest release: 1.8.0 (published 8 months ago)
Last Synced: 2026-07-24T21:23:46.875Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-24.11: python311Packages.queuelib

Collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/queuelib/default.nix#L21
Licenses: BSD-3-Clause
Latest release: 1.7.0 (published 9 months ago)
Last Synced: 2026-10-15T11:27:19.821Z (19 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-24.05: python311Packages.queuelib

A collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/queuelib/default.nix#L21
Licenses: BSD-3-Clause
Latest release: 1.7.0 (published 9 months ago)
Last Synced: 2026-05-11T22:14:31.468Z (6 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-23.05: python310Packages.queuelib

A collection of persistent (disk-based) queues for Python

Homepage: https://github.com/scrapy/queuelib
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.05/pkgs/development/python-modules/queuelib/default.nix#L19
Licenses: BSD-3-Clause
Latest release: 1.6.2 (published 9 months ago)
Last Synced: 2026-04-03T07:11:14.043Z (7 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

ubuntu-23.10: python-queuelib

Homepage: https://github.com/scrapy/queuelib
Licenses: bsd-3-clause
Latest release: 1.6.2-2 (published 9 months ago)
Last Synced: 2026-07-28T12:00:38.916Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

pkgsrc-netbsd-x86_64-10.1-all: devel/py-queuelib

Collection of persistent (disk-based) queues

Homepage: https://github.com/scrapy/queuelib
Documentation: https://pkgsrc.se/devel/py-queuelib
Licenses: modified-bsd
Latest release: 1.9.0 (published 8 months ago)
Last Synced: 2026-05-27T06:41:12.251Z (5 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

Dependencies

.github/workflows/checks.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/publish.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/tests.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

pyproject.toml pypi

setup.py pypi