https://github.com/x-hannibal/webshift
ai-agents bing-search bm25 brave-search context-window denoiser exa google-search html-cleaner html-to-text llm mcp mcp-server rust searxng serpapi tavily text-extraction web-scraping web-search
Score: 9.037652264150466
Last synced: about 10 hours ago
JSON representation
Repository metadata:
Shift noisy web pages into clean, context-ready text for LLMs — Rust library & MCP server
- Host: GitHub
- URL: https://github.com/x-hannibal/webshift
- Owner: x-hannibal
- License: mit
- Created: 2026-03-24T02:26:16.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2026-05-09T17:05:23.000Z (4 months ago)
- Last Synced: 2026-07-25T01:05:23.063Z (about 1 month ago)
- Topics: ai-agents, bing-search, bm25, brave-search, context-window, denoiser, exa, google-search, html-cleaner, html-to-text, llm, mcp, mcp-server, rust, searxng, serpapi, tavily, text-extraction, web-scraping, web-search
- Language: Rust
- Homepage:
- Size: 143 MB
- Stars: 7
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Owner metadata:
- Name: Hannibal
- Login: x-hannibal
- Email:
- Kind: user
- Description: SysAdmin & Dev | Constant Experimenter. If there's a way to hack a system to make it smarter, I'll find it.
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/3263978?u=613f0ae850cd2db1213e6b7cf74a36073597f2af&v=4
- Repositories: 1
- Last Synced at: 2026-04-02T08:12:54.829Z
- Profile URL: https://github.com/x-hannibal
GitHub Events
Total
- Push event: 2
- Release event: 1
- Total: 3
Last Year
- Push event: 2
- Release event: 1
- Total: 3
Committers metadata
Last synced: 1 day ago
Total Commits: 59
Total Committers: 2
Avg Commits per committer: 29.5
Development Distribution Score (DDS): 0.051
Commits in past year: 59
Committers in past year: 2
Avg Commits per committer in past year: 29.5
Development Distribution Score (DDS) in past year: 0.051
| Name | Commits | |
|---|---|---|
| Hannibal | a****x@g****m | 56 |
| Hannibal | 3****x | 3 |
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 1
Total pull requests: 0
Average time to close issues: about 3 hours
Average time to close pull requests: N/A
Total issue authors: 1
Total pull request authors: 0
Average comments per issue: 4.0
Average comments per pull request: 0
Merged pull request: 0
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 0
Past year average time to close issues: about 3 hours
Past year average time to close pull requests: N/A
Past year issue authors: 1
Past year pull request authors: 0
Past year average comments per issue: 4.0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- apriori (1)
Top Pull Request Authors
Top Issue Labels
Top Pull Request Labels
Package metadata
- Total packages: 2
-
Total downloads:
- cargo: 600 total
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 28
- Total maintainers: 1
crates.io: webshift-mcp
Denoised web search MCP server — native binary, zero runtime dependencies.
- Homepage:
- Documentation: https://docs.rs/webshift-mcp/
- Licenses: MIT
- Latest release: 0.2.14 (published 4 months ago)
- Last Synced: 2026-08-26T17:01:22.729Z (1 day ago)
- Versions: 14
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 227 Total
-
Rankings:
- Dependent repos count: 16.264%
- Dependent packages count: 21.485%
- Average: 42.984%
- Downloads: 91.203%
- Maintainers (1)
crates.io: webshift
Denoised web search library — fetch, clean, and rerank web content for AI agents.
- Homepage:
- Documentation: https://docs.rs/webshift/
- Licenses: MIT
- Latest release: 0.2.14 (published 4 months ago)
- Last Synced: 2026-08-26T17:02:11.484Z (1 day ago)
- Versions: 14
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 373 Total
-
Rankings:
- Dependent repos count: 16.264%
- Dependent packages count: 21.485%
- Average: 43.004%
- Downloads: 91.263%
- Maintainers (1)