https://github.com/AgentOps-AI/agentops

agent agentops agents-sdk ai anthropic autogen cost-estimation crewai evals evaluation-metrics groq langchain llm mistral ollama openai openai-agents

Score: 25.064106924043465

Last synced: about 5 hours ago
JSON representation

Repository metadata:

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Host: GitHub
URL: https://github.com/AgentOps-AI/agentops
Owner: AgentOps-AI
License: mit
Created: 2023-08-15T23:26:23.000Z (about 3 years ago)
Default Branch: main
Last Pushed: 2026-06-25T08:25:03.000Z (2 months ago)
Last Synced: 2026-08-24T12:17:24.270Z (1 day ago)
Topics: agent, agentops, agents-sdk, ai, anthropic, autogen, cost-estimation, crewai, evals, evaluation-metrics, groq, langchain, llm, mistral, ollama, openai, openai-agents
Language: Python
Homepage: https://agentops.ai
Size: 169 MB
Stars: 5,794
Watchers: 51
Forks: 614
Open Issues: 175
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE
- Code of conduct: .github/CODE_OF_CONDUCT.md

Owner metadata:

Name: agentops
Login: AgentOps-AI
Email:
Kind: organization
Description: Evals and observability for AI agents
Website: agentops.ai
Location: United States of America
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/140554352?v=4
Repositories: 1
Last Synced at: 2023-07-27T23:27:53.226Z
Profile URL: https://github.com/AgentOps-AI

GitHub Events

Total

Create event: 477
Delete event: 305
Discussion event: 1
Fork event: 319
Issue comment event: 1088
Issues event: 494
Pull request event: 817
Pull request review comment event: 492
Pull request review event: 735
Push event: 1986
Release event: 47
Watch event: 2970
Total: 9731

Last Year

Create event: 18
Delete event: 9
Discussion event: 1
Fork event: 43
Issue comment event: 41
Issues event: 15
Pull request event: 44
Pull request review comment event: 5
Pull request review event: 20
Push event: 28
Watch event: 276
Total: 500

Committers metadata

Last synced: 6 days ago

Total Commits: 791
Total Committers: 50
Avg Commits per committer: 15.82
Development Distribution Score (DDS): 0.707

Commits in past year: 23
Committers in past year: 5
Avg Commits per committer in past year: 4.6
Development Distribution Score (DDS) in past year: 0.565

Name	Email	Commits
Alex Reibman	a**n@g**m	232
Howard Gil	h**l@g**m	133
Braelyn Boynton	b**7@g**m	112
Shawn Qiu	s**u@g**m	57
Dwij	9****4	44
Pratyush Shukla	p**4@n**u	37
teocns	5****s	36
devin-ai-integration[bot]	1****]	23
Fenil Faldu	6****u	17
github-actions[bot]	4****]	15
Travis Dent	t**t@g**m	13
Albert Kim Jr	a**r@g**m	8
koreandinner	1****a	8
Taddy	t**s@g**m	6
Sri Laasya Nutheti	n**a@g**m	4
WalkerDev	5****r	3
AtomSilverman	1****n	2
Emmanuel Ferdman	e**n@g**m	2
Fernando Rocha	1****k	2
Evan Doyle	e**e@g**m	2
Hahnbee Lee	5****e	2
Ikko Eltociear Ashimine	e**r@g**m	2
Manu Suryavansh	s**u@g**m	2
Siddharth Prajosh	s**h@g**m	2
aiswaryasankar	a**s@b**u	2
AG2AI-Admin	g**b@a**i	1
zli11010	z**i@a**i	1
kelsey	e**l@g**m	1
kate yeh	k**1@g**m	1
andkoma	A**p@a**e	1
and 20 more...

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 408
Total pull requests: 1,152
Average time to close issues: 29 days
Average time to close pull requests: 4 days
Total issue authors: 93
Total pull request authors: 72
Average comments per issue: 0.72
Average comments per pull request: 1.12
Merged pull request: 780
Bot issues: 30
Bot pull requests: 143

Past year issues: 31
Past year pull requests: 38
Past year average time to close issues: 4 months
Past year average time to close pull requests: 9 days
Past year issue authors: 25
Past year pull request authors: 15
Past year average comments per issue: 1.58
Past year average comments per pull request: 0.5
Past year merged pull request: 12
Past year bot issues: 2
Past year bot pull requests: 11

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/AgentOps-AI/agentops

Top Issue Authors

areibman (140)
teocns (31)
the-praxs (26)
devin-ai-integration[bot] (26)
tcdent (26)
bboynton97 (21)
AtomSilverman (18)
Dwij1704 (15)
digitamaz (4)
anmol-aidora (3)
fenilfaldu (3)
sarath59 (2)
zli11010 (2)
Wendong-Fan (2)
Niharrrrrr (2)

Top Pull Request Authors

areibman (202)
HowieG (135)
Dwij1704 (118)
teocns (104)
bboynton97 (98)
devin-ai-integration[bot] (96)
the-praxs (83)
github-actions[bot] (47)
siyangqiu (46)
tcdent (40)
fenilfaldu (28)
thaddavis (13)
albertkimjunior (12)
michi-okahata (7)
TKTSWalker (6)

Top Issue Labels

bug (103)
enhancement (98)
documentation (29)
good first issue (19)
v0.4 (18)
help wanted (18)
roadmap (4)
question (2)
stale (1)
idea (1)
blocked (1)
feat (1)
blocker (1)
dev (1)
ci (1)
duplicate (1)

Top Pull Request Labels

stale (37)
enhancement (17)
codex (13)
documentation (11)
do not merge (9)
v0.4 (8)
bug (6)
in progress (3)
opinion (2)
help wanted (2)
ci (2)
blocker (1)
good first issue (1)
roadmap (1)
critical (1)

Package metadata

Total packages: 5
Total downloads:
- pypi: 257,231 last-month
Total dependent packages: 1 (may contain duplicates)
Total dependent repositories: 1 (may contain duplicates)
Total versions: 116
Total maintainers: 3

proxy.golang.org: github.com/AgentOps-AI/AgentOps

Homepage:
Documentation: https://pkg.go.dev/github.com/AgentOps-AI/AgentOps#section-documentation
Licenses: mit
Latest release: v0.3.13 (published almost 2 years ago)
Last Synced: 2026-08-24T12:17:51.595Z (1 day ago)
Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 5.472%
- Average: 5.655%
- Dependent repos count: 5.839%

proxy.golang.org: github.com/AgentOps-AI/agentops

Homepage:
Documentation: https://pkg.go.dev/github.com/AgentOps-AI/agentops#section-documentation
Licenses: mit
Latest release: v0.3.13 (published almost 2 years ago)
Last Synced: 2026-08-24T12:36:14.704Z (1 day ago)
Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

proxy.golang.org: github.com/agentops-ai/agentops

Homepage:
Documentation: https://pkg.go.dev/github.com/agentops-ai/agentops#section-documentation
Licenses: mit
Latest release: v0.3.13 (published almost 2 years ago)
Last Synced: 2026-08-24T12:26:33.555Z (1 day ago)
Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

pypi.org: agentops

Observability and DevTool Platform for AI Agents

Homepage: https://github.com/AgentOps-AI/agentops
Documentation: https://agentops.readthedocs.io/
Licenses: MIT License
Latest release: 0.4.21 (published 12 months ago)
Last Synced: 2026-08-24T12:10:38.414Z (1 day ago)
Versions: 106
Dependent Packages: 1
Dependent Repositories: 1
Downloads: 257,214 Last month
Rankings:
- Stargazers count: 5.367%
- Dependent packages count: 10.126%
- Downloads: 10.631%
- Average: 12.906%
- Forks count: 16.872%
- Dependent repos count: 21.535%
Maintainers (2)
- reibs
- shawnqiu

pypi.org: mseep-agentops

Observability and DevTool Platform for AI Agents

Homepage: https://github.com/AgentOps-AI/agentops
Documentation: https://mseep-agentops.readthedocs.io/
Licenses: MIT License
Latest release: 0.4.24 (published 12 months ago)
Last Synced: 2026-08-24T12:12:01.689Z (1 day ago)
Versions: 4
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 17 Last month
Rankings:
- Dependent packages count: 8.822%
- Average: 29.265%
- Dependent repos count: 49.708%
Maintainers (1)
- mseep

Dependencies

.github/workflows/python-publish.yml actions

actions/checkout v3 composite
actions/setup-python v3 composite
pypa/gh-action-pypi-publish 27b31702a0e7fc50959f5ad993c78deac1bdfc29 composite

pyproject.toml pypi

app/api/uv.lock pypi

130 dependencies

app/e2e/sdk-api/src/requirements.txt pypi

openai ==1.12.0

app/opentelemetry-collector/builder/uv.lock pypi

agentops 0.4.10
aiohappyeyeballs 2.6.1
aiohttp 3.11.18
aiosignal 1.3.2
annotated-types 0.7.0
anthropic 0.51.0
anyio 4.9.0
attrs 25.3.0
builder 0.1.0
certifi 2025.4.26
charset-normalizer 3.4.2
colorama 0.4.6
coverage 7.8.0
deprecated 1.2.18
distro 1.9.0
docker 7.1.0
frozenlist 1.6.0
googleapis-common-protos 1.70.0
h11 0.16.0
httpcore 1.0.9
httpx 0.28.1
idna 3.10
importlib-metadata 8.6.1
iniconfig 2.1.0
jinja2 3.1.6
jiter 0.9.0
markupsafe 3.0.2
multidict 6.4.3
opentelemetry-api 1.33.0
opentelemetry-exporter-otlp-proto-common 1.33.0
opentelemetry-exporter-otlp-proto-http 1.33.0
opentelemetry-instrumentation 0.54b0
opentelemetry-proto 1.33.0
opentelemetry-sdk 1.33.0
opentelemetry-semantic-conventions 0.54b0
ordered-set 4.1.0
packaging 24.2
pluggy 1.5.0
propcache 0.3.1
protobuf 5.29.4
psutil 6.0.0
pydantic 2.11.4
pydantic-core 2.33.2
pyjwt 2.10.1
pytest 8.3.5
pytest-cov 6.1.1
pywin32 310
pyyaml 6.0.2
regex 2024.11.6
requests 2.32.3
sniffio 1.3.1
termcolor 2.4.0
tiktoken 0.9.0
tokencost 0.1.26
typing-extensions 4.13.2
typing-inspection 0.4.0
urllib3 2.4.0
wrapt 1.17.2
yarl 1.20.0
zipp 3.21.0

app/pyproject.toml pypi

app/requirements-dev.txt pypi

ruff ==0.11.2 development

examples/agno/requirements.txt pypi

agno *
aiohttp *
arxiv *
duckduckgo-search *
googlesearch-python *
openai *
pycountry *
pypdf *

examples/anthropic/requirements.txt pypi

anthropic *

examples/autogen/requirements.txt pypi

autogen-agentchat ==0.6.1
autogen-ext *

examples/crewai/requirements.txt pypi

crewai *
crewai-tools *
pymarkdown ==0.1.4
pymarkdownlnt ==0.9.30
pymdown-extensions ==10.15

examples/google_adk/requirements.txt pypi

agentops *
deprecated *
google-adk *
google-genai ==1.16.1
nest-asyncio ==1.6.0
python-dotenv *

examples/haystack/requirements.txt pypi

haystack-ai >=2.0.0
openai >=1.102.0

examples/langchain/requirements.txt pypi

langchain *
langchain-openai *

.github/workflows/add-notebook-examples-to-docs.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
peter-evans/create-pull-request v7 composite

.github/workflows/compile-llms-txt.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

app/bun.lock npm

336 dependencies

app/dashboard/package.json npm

@cypress/code-coverage ^3.14.0 development
@next/bundle-analyzer ^15.2.4 development
@tanstack/react-query-devtools ^5.76.1 development
@types/d3 ^7.4.3 development
@types/d3-scale ^4.0.8 development
@types/jest ^29.5.5 development
@types/lodash ^4.17.16 development
@types/node ^20.2.3 development
@types/react ^18.2.7 development
@types/react-pivottable ^0.11.2 development
@types/react-syntax-highlighter ^15.5.11 development
@types/uuid ^10.0.0 development
@typescript-eslint/eslint-plugin ^7.0.0 development
@typescript-eslint/parser ^7.0.0 development
autoprefixer ^10.4.14 development
cross-env ^7.0.3 development
cypress ^14.3.0 development
cypress-mochawesome-reporter ^3.8.2 development
dotenv ^16.4.7 development
encoding ^0.1.13 development
eslint ^8.41.0 development
eslint-config-next ^15.2.2 development
eslint-config-prettier ^8.8.0 development
eslint-plugin-react ^7.32.2 development
eslint-plugin-tailwindcss ^3.12.0 development
jest ^29.7.0 development
postcss ^8.4.23 development
prettier ^3.2.5 development
prettier-plugin-tailwindcss ^0.5.13 development
supabase ^1.63.1 development
ts-jest ^29.1.1 development
typescript ^5.4.5 development
@ai-sdk/openai ^1.3.16
@assistant-ui/react ^0.9.5
@assistant-ui/react-ai-sdk ^0.9.4
@assistant-ui/react-markdown ^0.9.2
@hookform/resolvers ^3.3.4
@monaco-editor/react ^4.7.0
@radix-ui/react-accordion ^1.2.3
@radix-ui/react-alert-dialog ^1.1.6
@radix-ui/react-avatar ^1.1.3
@radix-ui/react-checkbox ^1.1.4
@radix-ui/react-collapsible ^1.1.3
@radix-ui/react-dialog ^1.1.6
@radix-ui/react-dismissable-layer ^1.1.10
@radix-ui/react-dropdown-menu ^2.1.6
@radix-ui/react-hover-card ^1.1.6
@radix-ui/react-icons ^1.3.0
@radix-ui/react-label ^2.1.2
@radix-ui/react-popover ^1.1.6
@radix-ui/react-primitive ^2.0.2
@radix-ui/react-progress ^1.1.2
@radix-ui/react-radio-group ^1.2.3
@radix-ui/react-scroll-area ^1.2.3
@radix-ui/react-select ^2.1.6
@radix-ui/react-separator ^1.1.2
@radix-ui/react-slider ^1.2.3
@radix-ui/react-slot ^1.2.0
@radix-ui/react-switch ^1.1.3
@radix-ui/react-tabs ^1.1.3
@radix-ui/react-toast ^1.2.6
@radix-ui/react-tooltip ^1.2.3
@radix-ui/react-visually-hidden ^1.1.2
@sentry/nextjs ^9.6.0
@stripe/react-stripe-js ^3.7.0
@stripe/stripe-js ^7.3.0
@tanstack/react-query ^5.74.4
@tanstack/react-query-devtools ^5.76.1
@tanstack/react-table ^8.21.2
@tanstack/react-virtual ^3.13.10
@vibe-kit/onboard ^0.0.5
@xyflow/react ^12.8.1
ai ^4.3.9
anser ^2.3.2
axios ^1.8.3
caniuse-lite ^1.0.30001715
class-variance-authority ^0.7.1
classnames ^2.5.1
clsx ^2.1.1
cmdk ^1.1.1
d3 ^7.9.0
d3-scale ^4.0.2
date-fns ^2.30.0
framer-motion ^11.3.18
hugeicons-react ^0.3.0
idb ^7.1.1
input-otp ^1.4.2
isomorphic-dompurify ^2.24.0
json-edit-react ^1.23.1
json5 ^2.2.3
lodash ^4.17.21
lucide-react ^0.501.0
next 15.2.3
next-themes ^0.4.6
nyc ^17.1.0
posthog-js ^1.246.0
posthog-node ^4.17.2
react ^18.2.0
react-day-picker ^8.10.0
react-dom ^18.2.0
react-hook-form ^7.54.2
react-markdown ^9.0.1
react-merge-refs ^2.1.1
react-pivottable ^0.11.0
react-resizable-panels ^2.1.7
react-syntax-highlighter ^15.6.1
reactflow ^11.11.4
recharts ^2.15.1
remark-gfm ^4.0.1
sharp ^0.33.5
stripe ^17.7.0
swr ^2.3.3
tailwind-merge ^1.14.0
tailwindcss ^3.3.2
tailwindcss-animate ^1.0.7
uuid ^11.1.0
vaul ^1.1.2
zod ^3.24.2

app/landing/package.json npm

@cypress/code-coverage ^3.14.0 development
@types/node ^20 development
@types/react ^18 development
@types/react-dom ^18 development
@types/react-syntax-highlighter ^15.5.13 development
eslint ^8 development
eslint-config-next 14.2.3 development
postcss ^8 development
prettier ^3.2.5 development
prettier-plugin-tailwindcss ^0.5.14 development
tailwindcss ^3.4.1 development
typescript ^5 development
lucide-react ^0.379.0
next 14.2.26
react ^18
react-dom ^18
react-syntax-highlighter ^15.5.0

app/package.json npm

@typescript-eslint/eslint-plugin ^7.0.0 development
@typescript-eslint/parser ^7.0.0 development
eslint ^8.50.0 development
eslint-config-next ^14.0.0 development
eslint-config-prettier ^9.0.0 development
eslint-plugin-import ^2.29.0 development
eslint-plugin-react ^7.33.0 development
eslint-plugin-react-hooks ^4.6.0 development
husky ^9.0.0 development
lint-staged ^15.0.0 development
prettier ^3.0.0 development
prettier-plugin-tailwindcss ^0.5.0 development
typescript ^5.3.0 development

docs/package.json npm

mintlify ^3.0.78
posthog-js ^1.130.2

app/api/pyproject.toml pypi

boto3 >=1.37.22
clickhouse-connect >=0.8.15
clickhouse-driver >=0.2.9
dotenv >=0.9.9
fastapi >=0.110.0
gotrue >=2.12.4
greenlet >=3.1.1
httpcore >=1.0.5
httpx >=0.27.0
jinja2 >=3.1.6
jockey *
jsonschema *
opentelemetry-api >=1.30.0
opentelemetry-sdk >=1.30.0
opentelemetry-semantic-conventions >=0.43b0
opentelemetry-semantic-conventions-ai >=0.4.2
psycopg [binary]>=3.2.5
psycopg-pool >=3.2.6
pydantic >=2.10.6
pyjwt >=2.8.0
python-dotenv >=1.0.0
redis >=5.2.1
sentry-sdk >=1.39.1
sqlalchemy >=2.0.40
stripe *
supabase >=2.12.0
termcolor >=2.0.0
tokencost >=0.1.26
uvicorn [standard]>=0.27.0
uvloop >=0.19.0
werkzeug >=3.0.3

app/deploy/jockey/pyproject.toml pypi

boto3 >=1.39.4
click >=8.0.0
docker >=6.0.0
fastapi >=0.100.0
gitpython >=3.1.0
jinja2 >=3.0.0
kubernetes >=28.0.0
python-dotenv >=1.0.0
pyyaml >=6.0
redis >=5.0.0
uvicorn >=0.23.0

app/deploy/jockey/uv.lock pypi

annotated-types 0.7.0
anyio 4.9.0
async-timeout 5.0.1
black 25.1.0
cachetools 5.5.2
certifi 2025.6.15
charset-normalizer 3.4.2
click 8.1.8
click 8.2.1
colorama 0.4.6
coverage 7.9.1
docker 7.1.0
durationpy 0.10
exceptiongroup 1.3.0
fastapi 0.115.13
gitdb 4.0.12
gitpython 3.1.44
google-auth 2.40.3
h11 0.16.0
httpcore 1.0.9
httpx 0.28.1
idna 3.10
iniconfig 2.1.0
jinja2 3.1.6
jockey 0.1.0
kubernetes 33.1.0
markupsafe 3.0.2
mypy-extensions 1.1.0
oauthlib 3.2.2
packaging 25.0
pathspec 0.12.1
platformdirs 4.3.8
pluggy 1.6.0
pyasn1 0.6.1
pyasn1-modules 0.4.2
pydantic 2.11.7
pydantic-core 2.33.2
pygments 2.19.1
pytest 8.4.0
pytest-cov 6.2.1
pytest-mock 3.14.1
python-dateutil 2.9.0.post0
python-dotenv 1.1.0
pywin32 310
pyyaml 6.0.2
redis 6.2.0
requests 2.32.4
requests-oauthlib 2.0.0
rsa 4.9.1
ruff 0.12.0
six 1.17.0
smmap 5.0.2
sniffio 1.3.1
starlette 0.46.2
tomli 2.2.1
typing-extensions 4.14.0
typing-inspection 0.4.1
urllib3 2.4.0
uvicorn 0.34.3
websocket-client 1.8.0

examples/watsonx/requirements.txt pypi

ibm-watsonx-ai *

examples/xai/requirements.txt pypi

openai *

uv.lock pypi

130 dependencies

docs/package-lock.json npm

347 dependencies

app/api/agentops/deploy/views/setup.py pypi

examples/google_genai/requirements.txt pypi

google-genai *
google-generativeai *

examples/litellm/requirements.txt pypi

litellm *

examples/openai_agents/requirements.txt pypi

openai *
openai-agents *

.github/workflows/docker-mcp-publish.yml actions

actions/checkout v4 composite
docker/build-push-action v5 composite
docker/login-action v3 composite
docker/metadata-action v5 composite
docker/setup-buildx-action v3 composite

.github/workflows/python-tests.yaml actions

actions/checkout v4 composite
astral-sh/setup-uv v5 composite
codecov/codecov-action v5 composite

.github/workflows/delete-bot-comments.yaml actions

actions/github-script v6 composite

.github/workflows/examples-integration-test.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/static-analysis.yaml actions

actions/checkout v4 composite
astral-sh/setup-uv v4 composite

app/deploy/redis_backup_service/Dockerfile docker

redis 8 build

examples/smolagents/requirements.txt pypi

duckduckgo-search *
markdownify *
pandas *
smolagents *
sqlalchemy *

app/opentelemetry-collector/builder/pyproject.toml pypi

agentops >=0.4.10
jinja2 >=3.1.6
pydantic >=2.11.4
tokencost >=0.1.26

app/uv.lock pypi

agentops-dev 0.1.0

examples/ag2/requirements.txt pypi

ag2 *
nest-asyncio *
wikipedia-api *

examples/langgraph/requirements.txt pypi

langchain-openai *
langgraph *

examples/mem0/requirements.txt pypi

mem0ai *

app/api/Dockerfile docker

python 3.12-slim-bookworm build

app/api/redis_server/Dockerfile docker

redis 7-alpine build

app/api/tests/_conftest/clickhouse_server/Dockerfile docker

clickhouse/clickhouse-server 24.12 build

app/api/tests/_conftest/supabase_server/Dockerfile docker

supabase/postgres 15.1.0.103 build

app/dashboard/Dockerfile docker

node 20-alpine build

app/e2e/sdk-api/Dockerfile docker

python 3.9-slim build

app/graphana/Dockerfile docker

grafana/grafana latest build

app/opentelemetry-collector/Dockerfile docker

agentopsai/otelcontribcol latest build
python 3.12-slim build

app/dashboard/bun.lock npm

1502 dependencies

examples/openai/requirements.txt pypi

datasets *
openai *
pandas *
pinecone *
tavily-python *

.github/workflows/stale-check.yml actions

actions/stale v9 composite

app/deploy/jockey/worker/Dockerfile docker

python 3.12-slim-bookworm build

examples/llamaindex/requirements.txt pypi

llama-index *
llama-index-instrumentation-agentops *
llama-index-llms-openai *

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary