https://github.com/adbar/trafilatura

article-extractor corpus-builder corpus-tools crawler html-to-markdown html2text llm news-aggregator news-crawler nlp rag readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Score: 29.521449626754503

Last synced: about 12 hours ago
JSON representation

Repository metadata:

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

• Host: GitHub
• URL: https://github.com/adbar/trafilatura
• Owner: adbar
• License: apache-2.0
• Created: 2019-04-08T11:38:48.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2026-09-25T13:15:52.000Z (7 days ago)
• Last Synced: 2026-09-26T10:59:58.606Z (6 days ago)
• Topics: article-extractor, corpus-builder, corpus-tools, crawler, html-to-markdown, html2text, llm, news-aggregator, news-crawler, nlp, rag, readability, rss-feed, scraping, tei, text-cleaning, text-extraction, text-mining, text-preprocessing, web-scraping
• Language: Python
• Homepage: https://trafilatura.readthedocs.io
• Size: 34.2 MB
• Stars: 6,869
• Watchers: 35
• Forks: 440
• Open Issues: 56
• Metadata Files:
  • Readme: README.md
  • Changelog: HISTORY.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Citation: CITATION.cff
• Funding:
  • Github: adbar
  • Ko fi: adbarbaresi

---

Owner metadata:

• Name: Adrien Barbaresi
• Login: adbar
• Email:
• Kind: user
• Description: Data Engineer and Scientist | Open Source Enthusiast
• Website: adrien.barbaresi.eu
• Location: Berlin
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/2125866?u=e2eeeb3384ab9391f598ade37d4388ad23199ebd&v=4
• Repositories: 32
• Last Synced at: 2026-09-25T09:42:58.447Z
• Profile URL: https://github.com/adbar

---

GitHub Events

Total

• Create event: 24
• Delete event: 26
• Fork event: 74
• Issue comment event: 163
• Issues event: 70
• Pull request event: 77
• Pull request review comment event: 27
• Pull request review event: 25
• Push event: 102
• Release event: 1
• Watch event: 1307
• Total: 1896

Last Year

• Create event: 4
• Delete event: 6
• Fork event: 12
• Issue comment event: 6
• Issues event: 9
• Pull request event: 10
• Push event: 25
• Watch event: 321
• Total: 393

---

Committers metadata

Last synced: 1 day ago

Name	Email	Commits
Adrien Barbaresi	b****i@b****e	1396
Felipe Hertzer	f****r@g****m	82
Vincent Barbaresi	v****i@g****m	12
Luise K	l****r@g****m	11
Cody	e****e@g****m	7
Sebastian Cao	c****l@g****m	5
LukasBBAW	6****W	5
Christiaan van Luik	c****n@y****l	5
MFA	m****i@g****m	4
Phong Nguyen	p****t@g****m	4
André Mácola	a****a@g****m	3
Ehsan	r****r@g****m	3
Ido Shamun	i****1@g****m	3
Igor Saevets	i****s	3
deedy5	6****5	2
Denis Moklaf	r****i@g****m	2
Vincent Gao	g****0@g****m	2
Tony Yang	t****a@g****m	2
Ruggero Marchei	r****i@d****t	2
Mohammad Hijjawi	5****7	2
Gregor Middell	g****r@m****t	2
Ellie Lockhart	6****t	2
Edward Krueger	e****r@g****m	2
Kristoffer Andersson	k****f@p****m	1
Korben	k****n@k****o	1
Kento Nozawa	k****w@k****p	1
Jan-Philipp Igla	h****o@j****e	1
Hergen Lehmann	3****m	1
François Schmidts	f****s@g****m	1
Eyüp Can Akman	e****n@g****m	1
and 50 more...

---

Issue and Pull Request metadata

Last synced: 1 day ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/adbar/trafilatura

---

---

---

Package metadata

• Total packages: 2
• Total downloads:
  • pypi: 11,943,639 last-month
• Total docker downloads: 9,653
• Total dependent packages: 71 (may contain duplicates)
• Total dependent repositories: 63 (may contain duplicates)
• Total versions: 93
• Total maintainers: 1

---

Dependencies