https://github.com/spotify/luigi
hadoop luigi orchestration-framework python scheduling
Score: 31.042438761387444
Last synced: 1 day ago
JSON representation
Repository metadata:
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
- Host: GitHub
- URL: https://github.com/spotify/luigi
- Owner: spotify
- License: apache-2.0
- Created: 2012-09-20T15:06:38.000Z (about 14 years ago)
- Default Branch: master
- Last Pushed: 2026-10-14T14:29:59.000Z (24 days ago)
- Last Synced: 2026-10-29T12:25:14.110Z (9 days ago)
- Topics: hadoop, luigi, orchestration-framework, python, scheduling
- Language: Python
- Homepage:
- Size: 11.1 MB
- Stars: 18,780
- Watchers: 446
- Forks: 2,475
- Open Issues: 194
-
Metadata Files:
- Readme: README.rst
- Contributing: CONTRIBUTING.rst
- License: LICENSE
- Codeowners: .github/CODEOWNERS
- Security: SECURITY.md
Owner metadata:
- Name: Spotify
- Login: spotify
- Email: opensource@spotify.com
- Kind: organization
- Description:
- Website: https://spotify.github.io/
- Location: Stockholm, Sweden
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/251374?v=4
- Repositories: 289
- Last Synced at: 2026-11-04T05:23:47.905Z
- Profile URL: https://github.com/spotify
GitHub Events
Total
- Create event: 2
- Delete event: 1
- Fork event: 54
- Issue comment event: 109
- Issues event: 30
- Pull request event: 72
- Pull request review comment event: 49
- Pull request review event: 77
- Push event: 35
- Release event: 2
- Watch event: 776
- Total: 1207
Last Year
- Fork event: 8
- Issue comment event: 28
- Issues event: 5
- Pull request event: 32
- Pull request review comment event: 15
- Pull request review event: 22
- Push event: 18
- Release event: 1
- Watch event: 71
- Total: 200
Committers metadata
Last synced: 2 days ago
Total Commits: 3,052
Total Committers: 622
Avg Commits per committer: 4.907
Development Distribution Score (DDS): 0.879
Commits in past year: 60
Committers in past year: 15
Avg Commits per committer in past year: 4.0
Development Distribution Score (DDS) in past year: 0.683
| Name | Commits | |
|---|---|---|
| Erik Bernhardsson | e****n@s****m | 369 |
| Arash Rouhani | a****h@s****m | 368 |
| Dave Buchfuhrer | b****k@h****m | 204 |
| Elias Freider | f****r@s****m | 123 |
| Guillaume Poulin | p****e@g****m | 91 |
| Dillon Stadther | d****r@g****m | 86 |
| hirosassa | h****a@g****m | 64 |
| Stephen Pascoe | S****e@n****m | 51 |
| Uldis Barbans | u****s@s****m | 47 |
| Alexander Krasnukhin | t****m@g****m | 45 |
| Honnix | h****x | 44 |
| Joe Crobak | j****w@g****m | 29 |
| Marcel R | r****a | 29 |
| drowoseque | s****l@p****u | 29 |
| Joe Crobak | j****e@f****m | 21 |
| Ryo Kitagawa | k****0@g****m | 21 |
| Anders Nyman | n****n@s****m | 20 |
| Fabian Alenius | f****n@s****m | 19 |
| Joe Ennever | j****r@f****m | 19 |
| Kyle Sun | k****e@h****m | 18 |
| Jakub Kukul | j****b@m****m | 18 |
| Fabrizio Demaria | f****a@s****m | 17 |
| Babis Kiosidis | c****s@g****m | 16 |
| Tashrif Billah | 3****h | 15 |
| Claire McGinty | c****m@s****m | 15 |
| Erik Bernhardsson | e****n@E****l | 14 |
| Berker Peksag | b****g@g****m | 14 |
| Romain Yon | r****n@s****m | 14 |
| Ran Tavory | r****v@g****m | 13 |
| Alex Brausewetter | a****x@x****e | 13 |
| and 592 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 118
Total pull requests: 222
Average time to close issues: 5 months
Average time to close pull requests: about 2 months
Total issue authors: 99
Total pull request authors: 104
Average comments per issue: 2.06
Average comments per pull request: 1.36
Merged pull request: 137
Bot issues: 0
Bot pull requests: 0
Past year issues: 9
Past year pull requests: 61
Past year average time to close issues: N/A
Past year average time to close pull requests: 24 days
Past year issue authors: 9
Past year pull request authors: 39
Past year average comments per issue: 0.67
Past year average comments per pull request: 0.74
Past year merged pull request: 19
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- Ali-Razmjoo (5)
- ccmaymay (5)
- starhel (4)
- marinelay (2)
- MrityunjoyS (2)
- acampove (2)
- franckOL (2)
- tashrifbillah (2)
- ttcm3010 (2)
- arteymix (2)
- dlstadther (2)
- saud5150 (1)
- bluezealot (1)
- Gollum999 (1)
- ttpro1995 (1)
Top Pull Request Authors
- hirosassa (16)
- starhel (12)
- dlstadther (8)
- Ali-Razmjoo (8)
- eltociear (5)
- hiro-o918 (5)
- reginaldalfret (5)
- kitagry (5)
- RRap0so (5)
- cpruijsen (4)
- ccmaymay (4)
- honnix (4)
- mateka (4)
- andresgomezfrr (4)
- bcamel (4)
Top Issue Labels
- wontfix (17)
- in progress (1)
- Affects contrib (only) (1)
Top Pull Request Labels
- wontfix (1)
Package metadata
- Total packages: 13
-
Total downloads:
- conda: 1,843,339 total
- pypi: 723,660 last-month
- Total docker downloads: 411
- Total dependent packages: 41 (may contain duplicates)
- Total dependent repositories: 607 (may contain duplicates)
- Total versions: 200
- Total maintainers: 17
- Total advisories: 2
nixpkgs-unstable: python314Packages.luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/luigi/default.nix#L54
- Licenses: Apache-2.0
- Latest release: 3.8.1 (published 4 months ago)
- Last Synced: 2026-11-01T11:34:46.768Z (6 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 0.087%
- Forks count: 0.155%
- Stargazers count: 0.191%
pypi.org: luigi
Workflow mgmgt + task scheduling + dependency resolution.
- Homepage: https://github.com/spotify/luigi
- Documentation: https://luigi.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 3.8.1 (published 6 months ago)
- Last Synced: 2026-11-05T03:37:36.460Z (2 days ago)
- Versions: 89
- Dependent Packages: 36
- Dependent Repositories: 586
- Downloads: 723,660 Last month
- Docker Downloads: 411
-
Rankings:
- Stargazers count: 0.118%
- Forks count: 0.31%
- Dependent packages count: 0.387%
- Downloads: 0.407%
- Average: 0.514%
- Dependent repos count: 0.583%
- Docker downloads count: 1.278%
- Maintainers (15)
- Advisories:
proxy.golang.org: github.com/spotify/luigi
- Homepage:
- Documentation: https://pkg.go.dev/github.com/spotify/luigi#section-documentation
- Licenses: apache-2.0
- Latest release: v3.8.1+incompatible (published 6 months ago)
- Last Synced: 2026-11-04T17:48:25.872Z (2 days ago)
- Versions: 16
- Dependent Packages: 0
- Dependent Repositories: 1
-
Rankings:
- Forks count: 0.148%
- Stargazers count: 0.472%
- Average: 3.467%
- Dependent repos count: 4.794%
- Dependent packages count: 8.453%
proxy.golang.org: github.com/Spotify/luigi
- Homepage:
- Documentation: https://pkg.go.dev/github.com/Spotify/luigi#section-documentation
- Licenses: apache-2.0
- Latest release: v3.8.1+incompatible (published 6 months ago)
- Last Synced: 2026-11-04T17:48:25.977Z (2 days ago)
- Versions: 17
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.337%
- Average: 4.483%
- Dependent repos count: 4.629%
conda-forge.org: luigi
- Homepage: https://github.com/spotify/luigi
- Licenses: Apache-2.0
- Latest release: 3.1.1 (published about 4 years ago)
- Last Synced: 2026-08-23T00:27:31.874Z (3 months ago)
- Versions: 42
- Dependent Packages: 4
- Dependent Repositories: 10
- Downloads: 1,804,244 Total
-
Rankings:
- Stargazers count: 2.001%
- Forks count: 2.226%
- Average: 6.928%
- Dependent repos count: 11.006%
- Dependent packages count: 12.478%
spack.io: py-luigi
Workflow mgmgt + task scheduling + dependency resolution
- Homepage: https://github.com/spotify/luigi
- Licenses: []
- Latest release: 3.2.0 (published over 3 years ago)
- Last Synced: 2026-11-04T17:48:26.189Z (2 days ago)
- Versions: 7
- Dependent Packages: 1
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Stargazers count: 0.486%
- Forks count: 0.597%
- Average: 7.288%
- Dependent packages count: 28.067%
- Maintainers (1)
anaconda.org: luigi
Luigi handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more. It also comes with Hadoop support built in.
- Homepage: https://github.com/spotify/luigi
- Licenses: Apache-2.0
- Latest release: 3.8.1 (published 3 months ago)
- Last Synced: 2026-07-30T12:03:54.999Z (3 months ago)
- Versions: 21
- Dependent Packages: 0
- Dependent Repositories: 10
- Downloads: 39,095 Total
-
Rankings:
- Stargazers count: 5.899%
- Forks count: 6.513%
- Average: 22.879%
- Dependent repos count: 38.076%
- Dependent packages count: 41.026%
nixpkgs-unstable: python313Packages.luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/luigi/default.nix#L54
- Licenses: Apache-2.0
- Latest release: 3.8.1 (published 4 months ago)
- Last Synced: 2026-11-01T10:59:46.489Z (6 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
nixpkgs-23.11: luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/applications/networking/cluster/luigi/default.nix#L21
- Licenses: Apache-2.0
- Latest release: 3.3.0 (published 9 months ago)
- Last Synced: 2026-03-08T07:27:33.466Z (8 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-23.05: luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.05/pkgs/applications/networking/cluster/luigi/default.nix#L21
- Licenses: Apache-2.0
- Latest release: 3.0.2 (published 9 months ago)
- Last Synced: 2026-04-03T04:22:38.085Z (7 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.11: luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/by-name/lu/luigi/package.nix#L37
- Licenses: Apache-2.0
- Latest release: 3.5.2 (published 9 months ago)
- Last Synced: 2026-10-23T18:27:06.583Z (14 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.05: luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/applications/networking/cluster/luigi/default.nix#L31
- Licenses: Apache-2.0
- Latest release: 3.5.1 (published 9 months ago)
- Last Synced: 2026-03-08T23:10:35.761Z (8 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-unstable: luigi
Python package that helps you build complex pipelines of batch jobs
- Homepage: https://github.com/spotify/luigi
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/luigi/default.nix#L54
- Licenses: Apache-2.0
- Latest release: 3.8.1 (published 6 days ago)
- Last Synced: 2026-11-01T10:16:21.793Z (6 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
Dependencies
- python-daemon <2.2.0; sys_platform == 'win32'
- python-daemon sys_platform != 'win32'
- python-dateutil >=2.7.5,<3
- tenacity >=9
- tornado >=5.0,<7
- typing-extensions >=4.12.2
- actions/checkout v6 composite
- astral-sh/setup-uv v7 composite
- codecov/codecov-action v5 composite
- postgres * docker
- actions/checkout v4 composite
- github/codeql-action/analyze v2 composite
- github/codeql-action/autobuild v2 composite
- github/codeql-action/init v2 composite
- 122 dependencies