Examples by Category

Automated Multi Agent Chat

AutoGen offers conversable agents powered by LLM, tool or human, which can be used to perform tasks collectively via automated chat. This framework allows tool use and human participation via multi-agent conversation. Please find documentation about this feature here.

Links to notebook examples:

Code Generation, Execution, and Debugging

• Automated Task Solving with Code Generation, Execution & Debugging - View Notebook
• Automated Code Generation and Question Answering with Retrieval Augmented Agents - View Notebook
• Automated Code Generation and Question Answering with Qdrant based Retrieval Augmented Agents - View Notebook

Multi-Agent Collaboration (>3 Agents)

• Automated Task Solving by Group Chat (with 3 group member agents and 1 manager agent) - View Notebook
• Automated Data Visualization by Group Chat (with 3 group member agents and 1 manager agent) - View Notebook
• Automated Complex Task Solving by Group Chat (with 6 group member agents and 1 manager agent) - View Notebook
• Automated Task Solving with Coding & Planning Agents - View Notebook
• Automated Task Solving with transition paths specified in a graph - View Notebook
• Running a group chat as an inner-monolgue via the SocietyOfMindAgent - View Notebook
• Running a group chat with custom speaker selection function - View Notebook

Sequential Multi-Agent Chats

• Solving Multiple Tasks in a Sequence of Chats Initiated by a Single Agent - View Notebook
• Async-solving Multiple Tasks in a Sequence of Chats Initiated by a Single Agent - View Notebook
• Solving Multiple Tasks in a Sequence of Chats Initiated by Different Agents - View Notebook

Nested Chats

• Solving Complex Tasks with Nested Chats - View Notebook
• Solving Complex Tasks with A Sequence of Nested Chats - View Notebook
• OptiGuide for Solving a Supply Chain Optimization Problem with Nested Chats with a Coding Agent and a Safeguard Agent - View Notebook
• Conversational Chess with Nested Chats and Tool Use - View Notebook

Swarms

• Orchestrating agents in a Swarm - View Notebook
• Orchestrating agents in a Swarm (Enhanced) - View Notebook

Applications

• Automated Continual Learning from New Data - View Notebook

• AutoAnny - A Discord bot built using AutoGen

RAG

• GraphRAG agent using FalkorDB (feat. swarms and Google Maps API) - View Notebook

Tool Use

• Web Search: Solve Tasks Requiring Web Info - View Notebook
• Use Provided Tools as Functions - View Notebook
• Use Tools via Sync and Async Function Calling - View Notebook
• Task Solving with Langchain Provided Tools as Functions - View Notebook
• RAG: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - View Notebook
• Function Inception: Enable AutoGen agents to update/remove functions during conversations. - View Notebook
• Agent Chat with Whisper - View Notebook
• Constrained Responses via Guidance - View Notebook
• Browse the Web with Agents - View Notebook
• SQL: Natural Language Text to SQL Query using the Spider Text-to-SQL Benchmark - View Notebook
• Web Scraping: Web Scraping with Apify - View Notebook
• Write a software app, task by task, with specially designed functions. - View Notebook.

Human Involvement

• Simple example in ChatGPT style View example
• Auto Code Generation, Execution, Debugging and Human Feedback - View Notebook
• Automated Task Solving with GPT-4 + Multiple Human Users - View Notebook
• Agent Chat with Async Human Inputs - View Notebook

Agent Teaching and Learning

• Teach Agents New Skills & Reuse via Automated Chat - View Notebook
• Teach Agents New Facts, User Preferences and Skills Beyond Coding - View Notebook
• Teach OpenAI Assistants Through GPTAssistantAgent - View Notebook
• Agent Optimizer: Train Agents in an Agentic Way - View Notebook

Multi-Agent Chat with OpenAI Assistants in the loop

• Hello-World Chat with OpenAi Assistant in AutoGen - View Notebook
• Chat with OpenAI Assistant using Function Call - View Notebook
• Chat with OpenAI Assistant with Code Interpreter - View Notebook
• Chat with OpenAI Assistant with Retrieval Augmentation - View Notebook
• OpenAI Assistant in a Group Chat - View Notebook
• GPTAssistantAgent based Multi-Agent Tool Use - View Notebook

Non-OpenAI Models

• Conversational Chess using non-OpenAI Models - View Notebook

Multimodal Agent

• Multimodal Agent Chat with DALLE and GPT-4V - View Notebook
• Multimodal Agent Chat with Llava - View Notebook
• Multimodal Agent Chat with GPT-4V - View Notebook

Long Context Handling

• Long Context Handling as A Capability - View Notebook

Evaluation and Assessment

• AgentEval: A Multi-Agent System for Assess Utility of LLM-powered Applications - View Notebook

Automatic Agent Building

• Automatically Build Multi-agent System with AgentBuilder - View Notebook
• Automatically Build Multi-agent System from Agent Library - View Notebook

Observability

• Track LLM calls, tool usage, actions and errors using AgentOps - View Notebook
• Cost Calculation - View Notebook

Enhanced Inferences

Utilities

• API Unification - View Documentation with Code Example
• Utility Functions to Help Managing API configurations effectively - View Notebook

Inference Hyperparameters Tuning

AutoGen offers a cost-effective hyperparameter optimization technique EcoOptiGen for tuning Large Language Models. The research study finds that tuning hyperparameters can significantly improve the utility of them. Please find documentation about this feature here.

Links to notebook examples:

• Optimize for Code Generation | Open in colab
• Optimize for Math | Open in colab