AI Gateway — Control Plane

TOTAL REQUESTS

—

all time

BLOCKED

—

by guardrails

REDACTED

—

PII stripped

AVG SEVERITY

—

composite score

ACTIVE TENANTS

—

with API keys

QUARANTINE

—

pending review

RECENT REQUESTS

TIME	TENANT	MODEL	PROVIDER	SEV	STATUS
No data — connect to gateway

SEVERITY DISTRIBUTION

SEV 1

0

SEV 2

0

SEV 3

0

SEV 4

0

SEV 5

0

REQUEST CONFIG

MODEL

TEMPERATURE

MAX TOKENS

SYSTEM PROMPT

CONVERSATION

◎

Send a message to test the gateway pipeline.

Requests run through guardrails → severity router → provider → response filter.

TENANTS

TENANT ID	DISPLAY NAME	REGIONS	MAX SEV	BUDGET	LIMITS	ACTIONS
No tenants loaded

CREATE TENANT

TENANT ID *

DISPLAY NAME

ALLOWED REGIONS Comma-separated ISO codes. Empty = global.

MAX SEVERITY (1–5)

BUDGET USD

RATE LIMIT (req/min)

RATE LIMIT (req/day)

TOKEN QUOTA (per min)

TOKEN QUOTA (per day)

AUDIT LOG

TIME	TENANT	REQUEST ID	MODEL REQ.	MODEL USED	PROVIDER	SEV	TOKENS	COST	ROUTING	GUARDRAILS	FLAGS
Load audit log above

QUARANTINE QUEUE

No items pending review

PROVIDER ROUTING CONFIG

NAME	TYPE	TIER	PRI	REGION	LOCAL	MODELS	DEFAULT MODEL	CREDS	STATUS	ACTIONS
No providers loaded

ADD PROVIDER

PROVIDER TYPE

NAME (unique key) *

DISPLAY NAME

LITELLM PREFIX Auto-filled from type; override if needed.

AUTH METHOD

BASE URL

REGION ISO alpha-2. Leave blank = multi-region.

API KEY

FOUNDRY INSTANCE

MODELS *

MODEL ALIASES

→

Map alternate model names to canonical provider model names.

DEFAULT MODEL Used when routing to this tier.

SEVERITY TIER

PRIORITY Lower = higher priority.

LOCAL ENABLED

GUARDRAIL COLLECTIONS

NAME	DESCRIPTION	RULES	STATUS	ACTIONS
No collections — group rules into themes to enable/disable them together

ADD COLLECTION

NAME (unique slug) * Alphanumeric, hyphens, underscores only.

DESCRIPTION

ENABLED

UNCOLLECTED RULES

NAME	DESCRIPTION	PATTERN	SEVERITY	STATUS	ACTIONS
No rules loaded

SEVERITY BEHAVIOUR REFERENCE

SEVERITY	LABEL	PIPELINE ACTION
SEV 1	CLEAR	Pass-through — route to cloud provider
SEV 2	LOW	Pass-through — route to cloud provider
SEV 3	MEDIUM	Redact PII — route to local / in-region model
SEV 4	HIGH	Route to restricted model — flag for quarantine review
SEV 5	CRITICAL	Hard block — 403 returned, no model call

ADD RULE

NAME (unique slug) * Alphanumeric, hyphens, underscores only.

DESCRIPTION

COLLECTION Optional. Disabling a collection disables all rules in it.

COLLECTION

REGEX PATTERN * Python-compatible regex, case-insensitive. Tested against full request text.

SEVERITY *

ENABLED

TEST PATTERN

MODELS IN USE

—

distinct models called

TOTAL COST

—

USD across all tenants

GUARDRAILS APPLIED

—

requests intercepted (SEV > 1)

SENSITIVE DATA PROTECTED

—

redacted — not sent to public LLM

MODELS USED

MODEL	REQUESTS	COST (USD)
No data — connect to gateway

PROVIDER BREAKDOWN

PROVIDER	REQUESTS	COST (USD)
No data — connect to gateway

Last updated: —

TENANT

PERIOD

Updated: —

TOTAL REQUESTS

—

in selected period

SUCCESS RATE

—

requests completed

BLOCK RATE

—

requests blocked

AVG RESPONSE TIME

—

milliseconds

REQUEST VOLUME BY DAY

SEVERITY DISTRIBUTION

SEV 1

0

SEV 2

0

SEV 3

0

SEV 4

0

SEV 5

0

TOP REQUESTED MODELS

MODEL	REQUESTS	BLOCKED	AVG TIME
No data

ⓘ Raw prompt content is not stored — model usage is the closest available proxy.

BLOCK REASONS

REASON	COUNT
No blocked requests

TOKEN USAGE

PROMPT TOKENS

—

COMPLETION TOKENS

—

REDACTED REQUESTS

—

TOTAL COST

—

TOTAL TESTS

—

last run

PASSED

—

FAILED

—

SKIPPED

—

PASS RATE

—

RUN EVALS

SUITE

Last run: —
Duration: —

STATUS CATEGORY

TEST RESULTS

CASE ID	CATEGORY	SUITE	STATUS	DURATION	FAILURE
No results — run evals or click REFRESH

IDENTITY PROVIDER

Connect to gateway to load configuration

ROLE MAPPINGS

Configure an identity provider first

AVAILABLE MODELS

Connect to gateway to list models

ADMIN USERS

Loading…

SIGN IN