https://github.com/jupyter-incubator/sparkmagic
cluster jupyter jupyter-notebook kerberos kernel livy magic notebook pandas-dataframe pyspark spark sql-query
Score: 25.968460025543354
Last synced: about 16 hours ago
JSON representation
Repository metadata:
Jupyter magics and kernels for working with remote Spark clusters
- Host: GitHub
- URL: https://github.com/jupyter-incubator/sparkmagic
- Owner: jupyter-incubator
- License: other
- Created: 2015-09-21T15:35:25.000Z (about 11 years ago)
- Default Branch: master
- Last Pushed: 2025-09-09T14:08:11.000Z (about 1 year ago)
- Last Synced: 2026-10-18T00:06:44.951Z (16 days ago)
- Topics: cluster, jupyter, jupyter-notebook, kerberos, kernel, livy, magic, notebook, pandas-dataframe, pyspark, spark, sql-query
- Language: Python
- Homepage:
- Size: 2.36 MB
- Stars: 1,368
- Watchers: 44
- Forks: 443
- Open Issues: 166
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE.md
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
Owner metadata:
- Name: jupyter-incubator
- Login: jupyter-incubator
- Email:
- Kind: organization
- Description:
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/14002361?v=4
- Repositories: 4
- Last Synced at: 2026-10-30T08:07:21.149Z
- Profile URL: https://github.com/jupyter-incubator
GitHub Events
Total
- Create event: 19
- Delete event: 25
- Fork event: 12
- Issue comment event: 58
- Issues event: 11
- Pull request event: 60
- Pull request review event: 3
- Push event: 42
- Release event: 5
- Watch event: 40
- Total: 275
Last Year
- Fork event: 1
- Issues event: 1
- Watch event: 1
- Total: 3
Committers metadata
Last synced: 2 days ago
Total Commits: 996
Total Committers: 69
Avg Commits per committer: 14.435
Development Distribution Score (DDS): 0.756
Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| Alejandro Guerrero Gonzalez | a****w@g****m | 243 |
| Devin Stein | d****n@s****u | 159 |
| Ricky Stewart | r****t@u****u | 94 |
| Alejandro Guerrero Gonzalez | a****g@A****l | 77 |
| Itamar Turner-Trauring | i****r@i****g | 55 |
| msftristew | r****w@m****m | 45 |
| Tomek | t****r@o****u | 41 |
| Mohamed El-Kamhawy | m****l@m****m | 39 |
| dependabot[bot] | 4****] | 36 |
| Gary He | g****e@d****m | 32 |
| jeffersonezra | j****a@m****m | 22 |
| linchan-ms | l****n@m****m | 19 |
| Alex Man | t****m@g****m | 10 |
| Ljubo Nikolić | l****c@g****m | 10 |
| Hanyu Cui | h****i@k****m | 9 |
| Adrian Petrescu | a****c@g****m | 7 |
| Pedro Rossi | p****r@c****r | 7 |
| Gaspard Blanchet | g****t@d****m | 4 |
| Auberon Lopez | a****z@g****m | 4 |
| Steve Suh | s****e@g****m | 4 |
| Linan Zheng | l****g@b****u | 3 |
| Oleg Strunevskiy | o****y@g****m | 3 |
| Peter | 1****g | 3 |
| juliusvonkohout | 4****t | 3 |
| Hanyu Cui | h****l@g****m | 3 |
| Eric Dill | e****l@a****m | 3 |
| Andor Markus | a****s@a****o | 3 |
| qiaoshi.wang | q****g@t****n | 3 |
| Swasti Kakker | s****r@s****z | 2 |
| Murat Migdisoglu | m****u@c****m | 2 |
| and 39 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 95
Total pull requests: 234
Average time to close issues: 8 months
Average time to close pull requests: 3 months
Total issue authors: 75
Total pull request authors: 33
Average comments per issue: 2.89
Average comments per pull request: 1.0
Merged pull request: 102
Bot issues: 0
Bot pull requests: 151
Past year issues: 0
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 0
Past year pull request authors: 0
Past year average comments per issue: 0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- gido3823 (8)
- devstein (3)
- itamarst (3)
- Armadik (3)
- rankol (2)
- devender-yadav (2)
- GaryLiuTelus (2)
- BertrandBrelier (2)
- rabejens (2)
- winston-zillow (2)
- cometta (2)
- vadensam (1)
- pkasinathan (1)
- jacgoldsm (1)
- JeffRodriguez (1)
Top Pull Request Authors
- dependabot[bot] (151)
- devstein (25)
- venu1412 (6)
- ljubon (5)
- anukaal (4)
- c2zwdjnlcg (3)
- andormarkus (2)
- Strunevskiy (2)
- stevenmanton (2)
- shay1bz (2)
- ektasharma4 (2)
- lhldyf (2)
- jeffeth-donaldson (2)
- utkarshgupta137 (2)
- hereisharish (2)
Top Issue Labels
- kind:bug (10)
- awaiting-submitter-response (2)
- kind:enhancement (2)
- Type: Bug (1)
- kind:question (1)
- Status: Stale (1)
- enhancement (1)
Top Pull Request Labels
- dependencies (151)
- python (127)
- size:XS (116)
- kind:enhancement (59)
- please code review (24)
- size:S (14)
- size:M (13)
- github_actions (11)
- kind:bug (9)
- lgtm (7)
- kind:documentation (6)
- size:L (1)
- awaiting-submitter-response (1)
Package metadata
- Total packages: 13
-
Total downloads:
- conda: 38,855 total
- pypi: 1,717,160 last-month
- Total docker downloads: 35,417
- Total dependent packages: 21 (may contain duplicates)
- Total dependent repositories: 279 (may contain duplicates)
- Total versions: 259
- Total maintainers: 6
pypi.org: hdijupyterutils
HdiJupyterUtils: Utils for Jupyter projects from HDInsight team
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Documentation: https://hdijupyterutils.readthedocs.io/
- Licenses: BSD 3-clause
- Latest release: 0.23.0 (published over 1 year ago)
- Last Synced: 2026-10-31T14:03:22.353Z (2 days ago)
- Versions: 55
- Dependent Packages: 3
- Dependent Repositories: 92
- Downloads: 852,780 Last month
- Docker Downloads: 11,946
-
Rankings:
- Docker downloads count: 0.839%
- Downloads: 1.189%
- Dependent repos count: 1.563%
- Average: 1.696%
- Stargazers count: 1.854%
- Dependent packages count: 2.134%
- Forks count: 2.6%
- Maintainers (4)
pypi.org: sparkmagic
SparkMagic: Spark execution via Livy
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Documentation: https://sparkmagic.readthedocs.io/
- Licenses: BSD 3-clause
- Latest release: 0.23.0 (published over 1 year ago)
- Last Synced: 2026-10-31T14:03:22.226Z (2 days ago)
- Versions: 58
- Dependent Packages: 4
- Dependent Repositories: 86
- Downloads: 12,187 Last month
- Docker Downloads: 11,793
-
Rankings:
- Docker downloads count: 0.839%
- Dependent packages count: 1.594%
- Dependent repos count: 1.611%
- Downloads: 1.687%
- Average: 1.697%
- Stargazers count: 1.854%
- Forks count: 2.6%
- Maintainers (5)
pypi.org: autovizwidget
AutoVizWidget: An Auto-Visualization library for pandas dataframes
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Documentation: https://autovizwidget.readthedocs.io/
- Licenses: BSD 3-clause
- Latest release: 0.23.0 (published over 1 year ago)
- Last Synced: 2026-10-31T14:03:28.031Z (2 days ago)
- Versions: 56
- Dependent Packages: 4
- Dependent Repositories: 93
- Downloads: 852,176 Last month
- Docker Downloads: 11,678
-
Rankings:
- Docker downloads count: 0.839%
- Downloads: 1.241%
- Dependent repos count: 1.553%
- Stargazers count: 1.854%
- Average: 1.887%
- Forks count: 2.6%
- Dependent packages count: 3.238%
- Maintainers (4)
proxy.golang.org: github.com/jupyter-incubator/sparkmagic
- Homepage:
- Status: removed
- Documentation: https://pkg.go.dev/github.com/jupyter-incubator/sparkmagic#section-documentation
- Licenses: other
- Latest release: v0.0.0-20151219080628-19744989f067 (published almost 11 years ago)
- Last Synced: 2026-10-31T14:03:23.285Z (2 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.35%
- Average: 4.496%
- Dependent repos count: 4.643%
conda-forge.org: hdijupyterutils
- Homepage: https://github.com/jupyter-incubator/sparkmagic/hdijupyterutils
- Licenses: BSD-3-Clause
- Latest release: 0.20.0 (published over 4 years ago)
- Last Synced: 2026-03-20T21:34:35.136Z (8 months ago)
- Versions: 10
- Dependent Packages: 4
- Dependent Repositories: 1
-
Rankings:
- Forks count: 8.164%
- Stargazers count: 11.592%
- Dependent packages count: 12.501%
- Average: 14.164%
- Dependent repos count: 24.397%
conda-forge.org: autovizwidget
- Homepage: https://github.com/jupyter-incubator/sparkmagic/autovizwidget
- Licenses: BSD-3-Clause
- Latest release: 0.20.0 (published over 4 years ago)
- Last Synced: 2026-04-02T15:47:55.799Z (7 months ago)
- Versions: 12
- Dependent Packages: 3
- Dependent Repositories: 1
-
Rankings:
- Forks count: 8.164%
- Stargazers count: 11.592%
- Average: 14.951%
- Dependent packages count: 15.649%
- Dependent repos count: 24.397%
conda-forge.org: sparkmagic
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Licenses: BSD-3-Clause
- Latest release: 0.20.0 (published over 4 years ago)
- Last Synced: 2026-04-08T09:55:57.804Z (7 months ago)
- Versions: 17
- Dependent Packages: 0
- Dependent Repositories: 2
-
Rankings:
- Forks count: 8.164%
- Stargazers count: 11.592%
- Dependent repos count: 20.256%
- Average: 22.902%
- Dependent packages count: 51.594%
anaconda.org: hdijupyterutils
Project with useful classes/methods for all projects created by the HDInsight team at Microsoft around Jupyter.
- Homepage: https://github.com/jupyter-incubator/sparkmagic/tree/master/hdijupyterutils
- Licenses: BSD-3-Clause
- Latest release: 0.23.0 (published over 1 year ago)
- Last Synced: 2026-03-11T23:07:36.173Z (8 months ago)
- Versions: 12
- Dependent Packages: 2
- Dependent Repositories: 1
- Downloads: 11,393 Total
-
Rankings:
- Forks count: 16.309%
- Dependent packages count: 20.447%
- Stargazers count: 21.776%
- Average: 27.484%
- Dependent repos count: 51.404%
anaconda.org: autovizwidget
AutoVizWidget: An Auto-Visualization library for pandas dataframes
- Homepage: https://github.com/jupyter-incubator/sparkmagic/tree/master/autovizwidget
- Licenses: BSD-3-Clause
- Latest release: 0.23.0 (published about 1 year ago)
- Last Synced: 2026-03-22T17:07:58.585Z (7 months ago)
- Versions: 12
- Dependent Packages: 1
- Dependent Repositories: 1
- Downloads: 13,367 Total
-
Rankings:
- Forks count: 16.309%
- Stargazers count: 21.776%
- Average: 30.036%
- Dependent packages count: 30.655%
- Dependent repos count: 51.404%
pypi.org: vnpt-autovizwidget
AutoVizWidget: An Auto-Visualization library for pandas dataframes
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Documentation: https://vnpt-autovizwidget.readthedocs.io/
- Licenses: BSD 3-clause
- Latest release: 0.1.2 (published almost 2 years ago)
- Last Synced: 2026-10-31T14:03:28.035Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 7 Last month
-
Rankings:
- Dependent packages count: 9.924%
- Average: 32.896%
- Dependent repos count: 55.867%
- Maintainers (1)
pypi.org: vnpt-hdijupyterutils
HdiJupyterUtils: Utils for Jupyter projects from HDInsight team
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Documentation: https://vnpt-hdijupyterutils.readthedocs.io/
- Licenses: BSD 3-clause
- Latest release: 0.1.1 (published almost 2 years ago)
- Last Synced: 2026-10-31T14:03:24.378Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 5 Last month
-
Rankings:
- Dependent packages count: 9.929%
- Average: 32.912%
- Dependent repos count: 55.894%
- Maintainers (1)
pypi.org: vnpt-sparkmagic
SparkMagic: Spark execution via Livy
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Documentation: https://vnpt-sparkmagic.readthedocs.io/
- Licenses: BSD 3-clause
- Latest release: 0.1.7 (published almost 2 years ago)
- Last Synced: 2026-10-31T14:03:29.897Z (2 days ago)
- Versions: 8
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 5 Last month
-
Rankings:
- Dependent packages count: 9.929%
- Average: 32.912%
- Dependent repos count: 55.894%
- Maintainers (1)
anaconda.org: sparkmagic
Sparkmagic is a set of tools for interactively working with remote Spark clusters in Jupyter notebooks. Sparkmagic interacts with remote Spark clusters through a REST server.
- Homepage: https://github.com/jupyter-incubator/sparkmagic
- Licenses: BSD-3-Clause
- Latest release: 0.23.0 (published about 1 year ago)
- Last Synced: 2026-08-13T18:30:20.873Z (3 months ago)
- Versions: 14
- Dependent Packages: 0
- Dependent Repositories: 2
- Downloads: 14,095 Total
-
Rankings:
- Forks count: 16.248%
- Stargazers count: 21.725%
- Average: 34.531%
- Dependent repos count: 48.956%
- Dependent packages count: 51.195%
Dependencies
- hdijupyterutils >=0.6
- ipywidgets >5.0.0
- notebook >=4.2
- pandas >=0.20.1
- plotly >=3
- hdijupyterutils >=0.6
- ipywidgets >5.0.0
- notebook >=4.2
- pandas >=0.20.1
- plotly >=3
- ipykernel >=4.2.2
- ipython >=4.0.2
- ipywidgets >5.0.0
- jupyter >=1
- mock *
- nose *
- notebook >=4.2
- numpy >=1.16.5
- pandas >=0.17.1
- ipykernel >=4.2.2
- ipython >=5
- ipywidgets >5.0.0
- jupyter >=1
- mock *
- nose *
- notebook >=4.2
- numpy *
- pandas >=0.17.1
- autovizwidget >=0.6
- hdijupyterutils >=0.6
- ipykernel >=4.2.2
- ipython >=4.0.2
- ipywidgets >5.0.0
- mock *
- nest_asyncio ==1.5.5
- nose *
- notebook >=4.2
- numpy *
- pandas >=0.17.1
- requests *
- requests_kerberos >=0.8.0
- tornado >=4
- autovizwidget >=0.6
- hdijupyterutils >=0.6
- ipykernel >=4.2.2
- ipython >=5
- ipywidgets >5.0.0
- mock *
- nest_asyncio ==1.5.5
- nose *
- notebook >=4.2
- numpy *
- pandas >=0.17.1
- requests *
- requests_kerberos >=0.8.0
- tornado >=4
- actions/checkout v4 composite
- docker/build-push-action v6 composite
- docker/login-action v3 composite
- docker/setup-buildx-action v3 composite
- docker/setup-qemu-action v3 composite
- 118 dependencies
- autovizwidget *
- hdijupyterutils *
- mock ^5.1.0
- numpy ^1.24.4
- pandas ^2.0.3
- pytest ^8.3.3
- python ^3.8
- sparkmagic *
- actions/checkout v4 composite
- actions/setup-python v5 composite
- pypa/gh-action-pypi-publish release/v1 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/checkout v4 composite
- psf/black stable composite
- actions/checkout v4 composite
- jasonamyers/github-bumpversion-action v1.0.5 composite
- ncipollo/release-action v1.14.0 composite
- jupyter/sparkmagic latest
- jupyter/sparkmagic-livy latest