https://github.com/apache/hamilton
dag data-analysis data-engineering data-science dataframe etl etl-framework etl-pipeline feature-engineering hacktoberfest lineage llmops machine-learning mlops orchestration pandas python rag software-engineering
Score: 25.09833321789064
Last synced: about 20 hours ago
JSON representation
Repository metadata:
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- Host: GitHub
- URL: https://github.com/apache/hamilton
- Owner: apache
- License: apache-2.0
- Created: 2023-02-23T17:16:48.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2026-08-19T04:38:48.000Z (7 days ago)
- Last Synced: 2026-08-24T13:36:03.669Z (2 days ago)
- Topics: dag, data-analysis, data-engineering, data-science, dataframe, etl, etl-framework, etl-pipeline, feature-engineering, hacktoberfest, lineage, llmops, machine-learning, mlops, orchestration, pandas, python, rag, software-engineering
- Language: Jupyter Notebook
- Homepage: https://hamilton.apache.org/
- Size: 178 MB
- Stars: 2,574
- Watchers: 17
- Forks: 211
- Open Issues: 154
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Security: SECURITY.md
- Notice: NOTICE
Owner metadata:
- Name: The Apache Software Foundation
- Login: apache
- Email:
- Kind: organization
- Description:
- Website: https://www.apache.org/
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/47359?v=4
- Repositories: 3145
- Last Synced at: 2026-08-22T00:20:57.842Z
- Profile URL: https://github.com/apache
GitHub Events
Total
- Create event: 103
- Delete event: 95
- Discussion event: 1
- Fork event: 16
- Issue comment event: 135
- Issues event: 45
- Member event: 1
- Pull request event: 190
- Pull request review comment event: 100
- Pull request review event: 179
- Push event: 221
- Release event: 1
- Watch event: 144
- Total: 1231
Last Year
- Create event: 75
- Delete event: 71
- Discussion event: 1
- Fork event: 10
- Issue comment event: 73
- Issues event: 35
- Member event: 1
- Pull request event: 132
- Pull request review comment event: 77
- Pull request review event: 124
- Push event: 150
- Release event: 1
- Watch event: 81
- Total: 831
Committers metadata
Last synced: 7 days ago
Total Commits: 2,065
Total Committers: 101
Avg Commits per committer: 20.446
Development Distribution Score (DDS): 0.591
Commits in past year: 266
Committers in past year: 27
Avg Commits per committer in past year: 9.852
Development Distribution Score (DDS) in past year: 0.639
| Name | Commits | |
|---|---|---|
| Stefan Krawczyk | s****n@d****o | 845 |
| elijahbenizzy | e****y@a****u | 606 |
| dependabot[bot] | 4****] | 119 |
| Thierry Jean | 6****o | 90 |
| Dev-iL | 6****L | 38 |
| jernejfrank | j****k@g****m | 36 |
| Charles Swartz | c****i@g****m | 29 |
| James Lamb | j****0@g****m | 26 |
| zilto | t****n@D****2 | 23 |
| Bryan Galindo | g****8@g****m | 18 |
| JoJo10Smith | j****2@g****m | 13 |
| Swapnil Dewalkar | s****r@g****m | 12 |
| PJ Fanning | p****g | 11 |
| Arnav Balyan | 6****n | 10 |
| Pablo Eduardo Diaz | p****0@g****m | 10 |
| zilto | t****n@D****n | 10 |
| Stefan Krawczyk | s****n@i****m | 10 |
| Sarah Haskins | s****s@g****m | 8 |
| rinsoft-sf | r****t@s****m | 8 |
| Josh Markovic | j****c@n****m | 6 |
| Konstantin Tyapochkin | t****s@g****m | 6 |
| Subham Chakravorty | s****2@g****m | 6 |
| Christopher Prohm | m****l@c****e | 5 |
| Roel Bertens | r****s@g****m | 5 |
| flaviassantos | 3****s | 4 |
| sT0v | 7****v | 4 |
| bovem | a****h@o****m | 4 |
| Shelly Jang | 4****g | 4 |
| Ryan Whitten | r****n@b****m | 4 |
| Sarah Haskins | s****s@S****m | 4 |
| and 71 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 27
Total pull requests: 193
Average time to close issues: about 2 months
Average time to close pull requests: 20 days
Total issue authors: 15
Total pull request authors: 36
Average comments per issue: 1.85
Average comments per pull request: 0.59
Merged pull request: 83
Bot issues: 0
Bot pull requests: 97
Past year issues: 16
Past year pull requests: 123
Past year average time to close issues: 2 months
Past year average time to close pull requests: 19 days
Past year issue authors: 13
Past year pull request authors: 33
Past year average comments per issue: 1.81
Past year average comments per pull request: 0.66
Past year merged pull request: 57
Past year bot issues: 0
Past year bot pull requests: 53
Top Issue Authors
- pjfanning (7)
- skrawcz (6)
- Phrogz (2)
- eric-czech (1)
- johnzielke (1)
- lorenzwalthert (1)
- jhrinv (1)
- jonas-meyer (1)
- harshith1118 (1)
- MitchellAcoustics (1)
- iprithv (1)
- leroyvn (1)
- tfrancisl (1)
- DaanSchar (1)
- CAMLM086 (1)
Top Pull Request Authors
- dependabot[bot] (97)
- skrawcz (27)
- pjfanning (12)
- Dev-iL (6)
- jernejfrank (4)
- officialasishkumar (4)
- elijahbenizzy (4)
- ArnavBalyan (4)
- Probablism (3)
- wenrizc (2)
- datashaman (2)
- harshith1118 (2)
- cswartzvi (2)
- charitarthchugh (2)
- sonalishintre (1)
Top Issue Labels
- triage (6)
- bug (3)
- help wanted (2)
- documentation (2)
- UI (1)
- good first issue (1)
- python (1)
- core-work (1)
- repo-hygiene (1)
- i/o (1)
Top Pull Request Labels
- dependencies (98)
- javascript (62)
- python (27)
- python:uv (8)
- core-work (1)
- repo-hygiene (1)
Package metadata
- Total packages: 9
-
Total downloads:
- pypi: 288,325 last-month
- Total dependent packages: 6 (may contain duplicates)
- Total dependent repositories: 3 (may contain duplicates)
- Total versions: 250
- Total maintainers: 4
proxy.golang.org: github.com/apache/hamilton
- Homepage:
- Documentation: https://pkg.go.dev/github.com/apache/hamilton#section-documentation
- Licenses: apache-2.0
- Latest release: v1.89.0-incubating-RC1 (published about 1 month ago)
- Last Synced: 2026-08-24T13:35:25.287Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.577%
- Average: 4.731%
- Dependent repos count: 4.885%
pypi.org: sf-hamilton
This package has moved to apache-hamilton. Install apache-hamilton instead.
- Homepage: https://github.com/apache/hamilton
- Documentation: https://hamilton.apache.org/
- Licenses: Apache-2.0
- Latest release: 1.90.0 (published 4 months ago)
- Last Synced: 2026-08-24T13:35:28.779Z (2 days ago)
- Versions: 224
- Dependent Packages: 6
- Dependent Repositories: 3
- Downloads: 180,859 Last month
-
Rankings:
- Stargazers count: 2.059%
- Downloads: 3.087%
- Average: 5.576%
- Forks count: 6.188%
- Dependent packages count: 7.373%
- Dependent repos count: 9.173%
- Maintainers (3)
pypi.org: apache-hamilton-ui
Apache Hamilton UI tracking server for dataflow visualization and monitoring.
- Homepage:
- Documentation: https://apache-hamilton-ui.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 0.0.18 (published about 1 month ago)
- Last Synced: 2026-08-24T13:41:33.901Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,647 Last month
-
Rankings:
- Dependent packages count: 7.64%
- Average: 25.42%
- Dependent repos count: 43.2%
- Maintainers (1)
pypi.org: apache-hamilton-sdk
Apache Hamilton SDK for reading and writing to the Apache Hamilton backend APIs that support the UI.
- Homepage:
- Documentation: https://apache-hamilton-sdk.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 0.9.0 (published about 1 month ago)
- Last Synced: 2026-08-24T13:43:50.640Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 3,912 Last month
-
Rankings:
- Dependent packages count: 7.64%
- Average: 25.42%
- Dependent repos count: 43.2%
- Maintainers (1)
pypi.org: apache-hamilton-lsp
Apache Hamilton Language Server powering IDE features.
- Homepage:
- Documentation: https://apache-hamilton-lsp.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 0.2.0 (published about 1 month ago)
- Last Synced: 2026-08-24T13:48:44.816Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 403 Last month
-
Rankings:
- Dependent packages count: 7.64%
- Average: 25.42%
- Dependent repos count: 43.2%
- Maintainers (1)
pypi.org: apache-hamilton-contrib
Apache Hamilton's user contributed shared dataflow library.
- Homepage:
- Documentation: https://apache-hamilton-contrib.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 0.0.9 (published about 1 month ago)
- Last Synced: 2026-08-24T13:34:45.773Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 21 Last month
-
Rankings:
- Dependent packages count: 7.64%
- Average: 25.42%
- Dependent repos count: 43.2%
- Maintainers (1)
pypi.org: apache-hamilton
Apache Hamilton (incubating) is a lightweight Python library for directed acyclic graphs (DAGs) of transformations. Your DAG is **portable**; it runs anywhere Python runs, whether it's a script, notebook, Airflow pipeline, FastAPI server, etc. Your DAG is **expressive**; Apache Hamilton has extensive features to define and modify the execution of a DAG (e.g., data validation, experiment tracking, remote execution).
- Homepage:
- Documentation: https://apache-hamilton.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 1.90.0 (published 4 months ago)
- Last Synced: 2026-08-24T13:34:39.564Z (2 days ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 100,494 Last month
-
Rankings:
- Dependent packages count: 8.453%
- Average: 28.118%
- Dependent repos count: 47.783%
- Maintainers (3)
pypi.org: sf-hamilton-lsp
This package has moved to apache-hamilton-lsp. Install apache-hamilton-lsp instead.
- Homepage: https://github.com/apache/hamilton
- Documentation: https://hamilton.apache.org/
- Licenses: Apache-2.0
- Latest release: 0.2.0 (published about 1 month ago)
- Last Synced: 2026-08-24T13:41:33.868Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 940 Last month
-
Rankings:
- Dependent packages count: 10.724%
- Average: 35.561%
- Dependent repos count: 60.398%
- Maintainers (2)
pypi.org: sf-hamilton-contrib
This package has moved to apache-hamilton-contrib. Install apache-hamilton-contrib instead.
- Homepage: https://github.com/apache/hamilton
- Documentation: https://hamilton.apache.org/
- Licenses: Apache-2.0
- Latest release: 0.0.9 (published about 1 month ago)
- Last Synced: 2026-08-24T13:35:24.559Z (2 days ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 49 Last month
-
Rankings:
- Dependent packages count: 7.358%
- Average: 38.062%
- Dependent repos count: 68.765%
- Maintainers (2)
Dependencies
- apache-hamilton *
- openai *
- @eslint/js ^9.17.0 development
- @types/node ^22.10.2 development
- @types/react-syntax-highlighter ^15.5.13 development
- @vitejs/plugin-react ^4.3.4 development
- autoprefixer ^10.4.24 development
- eslint ^9.17.0 development
- eslint-plugin-react ^7.37.2 development
- eslint-plugin-react-hooks ^5.1.0 development
- eslint-plugin-react-refresh ^0.4.16 development
- globals ^15.13.0 development
- husky ^9.1.7 development
- lint-staged ^15.2.11 development
- postcss ^8.5.14 development
- prettier ^3.4.2 development
- tailwindcss ^3.4.17 development
- ts-node ^10.9.2 development
- typescript ^5.7.2 development
- typescript-eslint ^8.18.2 development
- vite ^6.4.2 development
- @headlessui/react ^2.1.2
- @heroicons/react ^2.0.13
- @propelauth/react ^2.0.6
- @reduxjs/toolkit ^2.5.0
- @tailwindcss/forms ^0.5.3
- @tailwindcss/typography ^0.5.9
- @testing-library/jest-dom ^5.16.5
- @testing-library/react ^13.4.0
- @types/moment-timezone ^0.5.30
- @types/react ^18.0.26
- @types/react-dom ^18.0.10
- @types/react-router-hash-link ^2.4.5
- @types/react-select ^5.0.1
- @types/redux-persist ^4.3.1
- @uiw/react-json-view ^2.0.0-alpha.24
- chart.js ^4.3.0
- chartjs-adapter-date-fns ^3.0.0
- chartjs-plugin-zoom ^2.0.1
- date-fns ^2.30.0
- dayjs ^1.11.9
- elkjs ^0.8.2
- fuse.js ^6.6.2
- headlessui ^0.0.0
- http-proxy-middleware ^2.0.9
- moment-timezone ^0.5.40
- posthog-js ^1.82.1
- prism-react-renderer ^1.3.5
- react ^18.3.1
- react-chartjs-2 ^5.2.0
- react-diff-viewer-continued ^3.4.0
- react-dom ^18.3.1
- react-draggable ^4.4.5
- react-icons ^5.3.0
- react-markdown ^9.0.1
- react-micro-bar-chart ^1.1.1
- react-redux ^9.1.2
- react-router-dom ^6.28.0
- react-router-hash-link ^2.4.3
- react-select ^5.8.3
- react-syntax-highlighter ^16.1.1
- react-tailwindcss-datepicker ^1.6.1
- react-time-ago ^7.2.1
- react-visibility-sensor ^5.1.1
- reactflow ^11.4.0
- redux-persist ^6.0.0
- tailwind-scrollbar-hide ^1.1.7
- tailwindcss-question-mark ^0.1.1
- typescript ^4.9.4
- web-vitals ^2.1.4
- click *
- duckdb ==0.5.0
- apache-hamilton *
- numpy *
- scipy *
- apache-hamilton *
- pandas *
- faiss-cpu *
- langchain *
- langchain-community *
- langchain-openai *
- matplotlib *
- mlforecast *
- pandas *
- utilsforecast *
- apache-hamilton [visualization]>=1.56
- pygls >=1.3.1
- apache-hamilton *
- langchain *
- langchain-core *
- @docusaurus/module-type-aliases ^3.9.2 development
- @docusaurus/tsconfig ^3.9.2 development
- @docusaurus/types ^3.9.2 development
- @docusaurus/core ^3.9.2
- @docusaurus/plugin-client-redirects ^3.9.2
- @docusaurus/plugin-google-gtag ^3.9.2
- @docusaurus/plugin-sitemap ^3.9.2
- @docusaurus/preset-classic ^3.9.2
- @docusaurus/theme-search-algolia ^3.9.2
- @mdx-js/react ^3.0.0
- clsx ^2.0.0
- prism-react-renderer ^2.0.0
- raw-loader ^4.0.2
- react ^18.0.0
- react-dom ^18.0.0
- boto3 *
- pandas *
- pandas *
- apache-hamilton *
- numpy *
- pandas *
- pyarrow *
- scikit-learn *
- apache-hamilton *
- pandas *
- requests *
- streamlit *
- sagemaker *
- apache-hamilton *
- apache-hamilton *
- arxiv *
- requests *
- streamlit *
- apache-hamilton *
- bytewax *
- fastapi *
- uvicorn *
- apache-hamilton *
- apache-hamilton-sdk *
- apache-hamilton-ui *
- apache-hamilton *
- polars *
- apache-hamilton *
- langchain *
- langchain-core *
- pyspark *
- aiohttp *
- apache-hamilton *
- fastapi *
- uvicorn *
- apache-hamilton >=1.24.0
- pandas *
- pyarrow *
- apache-hamilton *
- aiohttp *
- apache-hamilton >=1.43.0
- click *
- gitpython *
- jinja2 *
- loguru *
- posthog *
- requests *
- sqlglot *
- apache-hamilton *
- numpy *
- scipy *
- apache-hamilton *
- apache-hamilton *
- scikit-learn *
- apache-hamilton *
- lxml *
- pandas *
- 673 dependencies
- litellm *
- apache-hamilton *
- fastapi *
- pandas *
- pandera *
- uvicorn *
- apache-hamilton *
- fastparquet *
- matplotlib *
- numpy *
- pandas *
- pyarrow *
- scikit-learn *
- aiohttp *
- apache-hamilton *
- fastapi *
- pandas *
- pandera *
- uvicorn *
- apache-hamilton *
- pandas *
- apache-hamilton *
- click *
- pandas *
- pyarrow *
- scikit-learn *
- apache-hamilton *
- aiofiles *
- aiohttp *
- colorlog *
- django *
- django-extensions *
- django-ninja >=1.1.0
- passlib *
- psycopg2-binary *
- black * development
- openapi-python-client * development
- pandera * development
- prek * development
- ruff * development
- scikit-learn * development
- matplotlib *
- numpy *
- pandas *
- statsforecast *
- utilsforecast *
- apache-hamilton *
- feast *
- jupyter *
- pandas *
- apache-hamilton *
- numpy *
- openai *
- pandas *
- pandera *
- plotly *
- requests *
- scikit-learn *
- tenacity *
- torch *
- apache-hamilton *
- beautifulsoup4 *
- lxml *
- requests *
- Faker ==18.4.0
- apache-hamilton *
- dagster *
- dagster-webserver *
- dagster_duckdb *
- dagster_duckdb_pandas *
- matplotlib *
- pandas *
- requests *
- apache-hamilton *
- ibis-framework *
- apache-hamilton *
- polars *
- xlsx2csv *
- xlsxwriter *
- aiohttp *
- click *
- gitpython *
- jinja2 *
- loguru *
- posthog *
- requests *
- sqlglot *
- python 3.11-slim-buster build
- apache-hamilton *
- scikit-learn *
- apache-hamilton *
- mlflow *
- numpy *
- pandas *
- scikit-learn *
- aiofiles *
- aiohttp >=3.13.0
- apache-hamilton >=1.90.0
- click *
- colorlog *
- ddtrace >=2.21.0
- django >=4.2.0
- django-extensions *
- django-ninja >=1.1.0
- loguru *
- passlib *
- psycopg2-binary *
- pydantic >=2.0.0
- requests >=2.32.0
- typer *
- absl-py *
- apache-hamilton *
- datasets *
- evaluate *
- numpy *
- pandas *
- peft *
- rouge-score *
- scikit-learn *
- torch *
- tqdm *
- transformers *
- PyPDF2 *
- apache-hamilton *
- arxiv *
- openai ==0.28.0
- pandas *
- requests *
- scipy *
- tenacity *
- termcolor *
- tiktoken ==0.3.3
- tqdm *
- apache-hamilton *
- apache-hamilton *
- flask *
- mkdocs ==1.4.2
- myst-parser *
- apache-hamilton *
- apache-hamilton *
- pytest *
- scikit-learn *
- apache-hamilton *
- openlineage-python *
- apache-hamilton *
- boto3 *
- pandas *
- pyarrow *
- ibis-framework * test
- langchain_core * test
- numpy * test
- polars * test
- pyarrow * test
- pyarrow_hotfix * test
- pydantic * test
- pyspark * test
- pytest * test
- ray * test
- faiss-cpu *
- langchain *
- langchain-community *
- langchain-openai *
- apache-hamilton *
- numpy *
- optuna *
- pandas *
- scikit-learn *
- xgboost *
- apache-hamilton *
- ipywidgets *
- pandas *
- apache-hamilton *
- jupyter *
- pandas *
- apache-hamilton *
- beautifulsoup4 *
- prompt_toolkit *
- selenium *
- webdriver-manager *
- pytest-asyncio * test
- pytest-django * test
- neo4j 5.18.0
- dagworks/ui-backend latest
- dagworks/ui-frontend latest
- postgres 18
- apache-hamilton *
- apache-hamilton *
- plotly *
- openai *
- apache-hamilton *
- dlt >=0.3.12
- ibis-framework *
- openai *
- pandas *
- polars *
- streamlit *
- apache/airflow latest-python3.10 build
- apache-hamilton *
- langchain *
- langchain-core *
- boto3 *
- openai *
- altair *
- apache-hamilton *
- apache-hamilton-contrib *
- boto3 *
- burr *
- openai *
- opentsne *
- pandas *
- pillow *
- s3fs *
- scikit-learn *
- st-files-connection *
- streamlit *
- streamlit-super-slider *
- tenacity *
- apache-hamilton *
- apache-hamilton *
- boto3 *
- pillow *
- anthropic *
- apache-hamilton *
- lanchain_openai *
- langchain *
- openai *
- apache-hamilton *
- apache-hamilton-contrib *
- numpy *
- optuna *
- pandas *
- sklearn *
- xgboost *
- numpy *
- pandas *
- typing-extensions > 4.0.0
- typing-inspect *
- python 3.13.1-slim build
- apache-hamilton *
- lancedb *
- numpy *
- pyarrow *
- apache-hamilton *
- fastapi *
- fastui *
- openai *
- pypdf *
- tiktoken *
- PyPDF2 *
- apache-hamilton ==1.27.3
- arxiv *
- fastapi *
- openai *
- pandas *
- pydantic *
- python-multipart *
- tenacity *
- tiktoken *
- uvicorn *
- weaviate-client *
- openai *
- apache-hamilton *
- click *
- scikit-learn *
- apache-hamilton *
- narwhals *
- pandas *
- polars *
- PyPDF2 *
- openai *
- tenacity *
- tiktoken *
- tqdm *