LiteLLM Onboarding

LiteLLM is an open-source gateway that gives you one consistent, OpenAI-compatible interface for calling 100+ LLMs — OpenAI, Anthropic, Azure, Bedrock, and more — without rewriting code per provider. Most teams run it as a self-hosted proxy to centralize auth, routing, and spend tracking across all their LLM usage.

Connect it here so that cost data flows into Mavvrik automatically, across every model routed through it — LiteLLM exports it as FOCUS 1.2 formatted cost reports, the FinOps Foundation's open cost-and-usage standard. This integration requires LiteLLM v1.91.0 and above.

Official Reference: https://docs.litellm.ai/docs/observability/mavvrik

Note: on first connect, only the last 7 days of usage are backfilled — earlier history is not fetched.

Step 1: Set up the account

1. Click + Account under genAI and choose LiteLLM.

2. Mavvrik generates an Account ID for you automatically — you won't need to enter this yourself.

3. Give it an Account Name so you can recognize it later.

4. Click Next.

Step 2: Connect your proxy

Follow the three steps shown on the Connect tab:

Step 1 — Add Mavvrik to your config.yaml

litellm_settings:
  callbacks: ["mavvrik"]

Step 2 — Set the environment variables

Copy the three variables shown in Mavvrik — they're generated specifically for this account, so don't reuse them from a different connection:

export MAVVRIK_API_KEY="<your account's API key, shown in Mavvrik>"
export MAVVRIK_API_ENDPOINT="<your account's API endpoint, shown in Mavvrik>"
export MAVVRIK_CONNECTION_ID="litellm-<your account ID>"

Step 3 — Restart the proxy, then connect

litellm --config config.yaml

Once your proxy is back up and picking up the new config, click Connect.