Skip to main content

​
Setting up LLM Keys

If you are contributing to the AG2 project, you will need an LLM key depending on the submodule you are working on.
  • Using OAI_CONFIG_LIST
  • Using LLM keys directly
AG2 uses an environment variable called OAI_CONFIG_LIST in JSON format to store the LLM keys. OAI_CONFIG_LIST is a list of dictionaries where each dictionary contains the following keys:
  • model(required): The name of the OpenAI/LLM model.
  • api_key(optional): The API key for the OpenAI/LLM model.
  • api_type(optional): The type of the API key. It is used for non-OpenAI LLMs.
  • api_version(optional): The version of the API key. It is used for Azure API.
  • base_url(optional): The base URL for the OpenAI/LLM model.
  • tags(optional): A list of tags for the OpenAI/LLM model which can be used for filtering.
Following is an example of the OAI_CONFIG_LIST in JSON format which consists of two OpenAI models and a gemini model:
[
    {
        "model": "gpt-4o",
        "api_key": "<your_api_key>",
        "tags": ["gpt-4o", "tool", "vision"]
    },
    {
        "model": "gpt-4o-mini",
        "api_key": "<your_api_key>",
        "tags": ["gpt-4o-mini", "tool", "vision"]
    },
    {
        "api_type": "google",
        "model": "gemini-pro",
        "api_key": "<your_gemini_api_key>",
    }
]
Further, this OAI_CONFIG_LIST can be set in two ways:
  • As environment variable
  • As file
Simply set the OAI_CONFIG_LIST environment variable in your terminal:
export OAI_CONFIG_LIST='[{"api_type": "openai", "model": "gpt-4o","api_key": "<your_api_key>","tags": ["gpt-4o", "tool", "vision"]},{"api_type": "openai", "model": "gpt-4o-mini","api_key": "<your_api_key>","tags": ["gpt-4o-mini", "tool", "vision"]},{"api_type": "google", "model": "gemini-pro","api_key": "<your_gemini_api_key>",}]'
Learn more about OAI_CONFIG_LIST here.

​
Setting up the Development Environment

To contribute to the AG2 project, AG2 provides three different methods to set up the development environment:
  • Dev Containers
  • Codespaces
  • Virtual Environment
  1. Setup the necessary LLM keys as mentioned above in your terminal.
  2. Clone the AG2 repository and cd into the repository.
  3. Open the project in Visual Studio Code by running the following command from the root of the repository: 
    code .
  4. Press Ctrl+Shift+P and select Dev Containers: Reopen in Container.
  5. Select the desired python environment and wait for the container to build.
  6. Once the container is built, you can start developing AG2.

​
Verifying the Development Environment

To make sure that we have set up the development environment correctly, we can run the pre-commit hooks and tests. To run the pre-commit hooks, run the following command: 
pre-commit run --all-files
To run the non-llm tests, run the following command: 
bash scripts/test-core-skip-llm.sh
Edit this page
⌘I