> ## Documentation Index
> Fetch the complete documentation index at: https://docs.ag2.ai/llms.txt
> Use this file to discover all available pages before exploring further.
# Agent Monitoring and Debugging with AgentOps
[AgentOps](https://agentops.ai/?=autogen) provides session replays, metrics, and monitoring for AI agents.
At a high level, AgentOps gives you the ability to monitor LLM calls, costs, latency, agent failures, multi-agent interactions, tool usage, session-wide statistics, and more. For more info, check out the [AgentOps Repo](https://github.com/AgentOps-AI/agentops).
| | |
| ------------------------------------- | ------------------------------------------------------------- |
| ๐ **Replay Analytics and Debugging** | Step-by-step agent execution graphs |
| ๐ธ **LLM Cost Management** | Track spend with LLM foundation model providers |
| ๐งช **Agent Benchmarking** | Test your agents against 1,000+ evals |
| ๐ **Compliance and Security** | Detect common prompt injection and data exfiltration exploits |
| ๐ค **Framework Integrations** | Native Integrations with CrewAI, AG2, & LangChain |
[](https://app.agentops.ai/signin?ref=gh)
[](https://app.agentops.ai/signin?ref=gh)
[](https://app.agentops.ai/signin?ref=gh)
## Installation
AgentOps works seamlessly with applications built using AG2.
1. **Install AgentOps**
```bash theme={null}
pip install agentops
```
2. **Create an API Key:**
Create a user API key here: [Create API Key](https://app.agentops.ai/settings/projects)
3. **Configure Your Environment:**
Add your API key to your environment variables
```
AGENTOPS_API_KEY=
```
4. **Initialize AgentOps**
To start tracking all available data on AG2 runs, simply add two lines of code before using AG2.
```python theme={null}
import agentops
agentops.init() # Or: agentops.init(api_key="your-api-key-here")
```
After initializing AgentOps, AG2 will now start automatically tracking your agent runs.
## Features
* **LLM Costs**: Track spend with foundation model providers
* **Replay Analytics**: Watch step-by-step agent execution graphs
* **Recursive Thought Detection**: Identify when agents fall into infinite loops
* **Custom Reporting:** Create custom analytics on agent performance
* **Analytics Dashboard:** Monitor high level statistics about agents in development and production
* **Public Model Testing**: Test your agents against benchmarks and leaderboards
* **Custom Tests:** Run your agents against domain specific tests
* **Time Travel Debugging**: Save snapshots of session states to rewind and replay agent runs from chosen checkpoints.
* **Compliance and Security**: Create audit logs and detect potential threats such as profanity and PII leaks
* **Prompt Injection Detection**: Identify potential code injection and secret leaks
## AG2 + AgentOps examples
* [AgentChat with AgentOps Notebook](/docs/use-cases/notebooks/notebooks/agentchat_agentops)
* [More AgentOps Examples](https://docs.agentops.ai/v1/quickstart)
## Extra links
* [๐ฆ X](https://x.com/agentopsai/)
* [๐ข Discord](https://discord.gg/JHPt4C7r)
* [๐๏ธ AgentOps Dashboard](https://app.agentops.ai/signin)
* [๐ Documentation](https://docs.agentops.ai/introduction)