- About
- Open-source LLM observability, evaluation and agent tracing. Open-source alternative to LangSmith and Weights & Biases.
- Catalogue
- No. 212
- Category
- Development
- GitHub stars
- ★ 0
Overview
Opik is an open-source platform from Comet that covers the LLM application lifecycle, from the first trace in development to production monitoring, for teams building LLM apps and AI agents.
What it does well
Opik traces LLM calls and multi-step agents with full trace trees, evaluates with datasets, experiments and LLM-as-a-judge metrics for hallucination, moderation and RAG quality, and runs evaluations in CI through a PyTest integration. It adds production dashboards, guardrails, a prompt playground and an Agent Optimizer SDK.
Why it’s in the collection
Opik pairs tracing with strong built-in evaluation metrics, which makes it a good fit when testing AI output is the main job. It is Apache-licensed.
On GitHub
- Stars
- 0
- Forks
- 0
- Commits
- 0
- Repository
- comet-ml/opik
Languages
- Python 54.8%
- TypeScript 41.6%
- Shell 2.9%
- Other 0.7%
Compared with
LangSmithLangChain's platform for tracing and evaluating LLM apps.- WWeights & BiasesML experiment tracking and LLM evaluation platform.
LangfuseNo. 211Open-source LLM engineering and observability platform.
See every open-source alternative to LangSmith in the collection.
