Get AI Config metrics by variation

For the complete documentation index, see llms.txt. For the full documentation snapshot, see llms-full.txt.

Retrieve usage metrics for an AI Config by config key, with results split by variation.

GET /api/v2/projects/{projectKey}/ai-configs/{configKey}/metrics-by-variation

Get AI Config metrics by variation

cURL

curl --request GET \
  --url https://app.launchdarkly.com/api/v2/projects/{projectKey}/ai-configs/{configKey}/metrics-by-variation \
  --header 'Authorization: <api-key>'

200

[
  {
    "metrics": {
      "judgeRelevance": 0.14894159,
      "inputCost": 7.386281948385884,
      "outputCost": 1.2315135367772556,
      "generationSuccessCount": 5,
      "inputTokens": 0,
      "generationErrorCount": 2,
      "thumbsDown": 9,
      "judgeToxicity": 0.6846853,
      "totalTokens": 1,
      "judgeAccuracy": 0.10246457,
      "generationCount": 5,
      "timeToFirstTokenMs": 2,
      "outputTokens": 6,
      "thumbsUp": 7,
      "durationMs": 3,
      "satisfactionRating": 0.4145608
    },
    "variationKey": "variationKey"
  }
]

Authorizations

Authorization · string · header · required

Path Parameters

projectKey · string · required

configKey · string · required

Query Parameters

from · integer · required

The starting time, as milliseconds since epoch (inclusive).

to · integer · required

The ending time, as milliseconds since epoch (exclusive). May not be more than 100 days after from.

env · string · required

An environment key. Only metrics from this environment will be included.

Response

200

application/json

Metrics computed

variationKey · string

metrics · object

Show child attributes

Example:

{
  "judgeRelevance": 0.14894159,
  "inputCost": 7.386281948385884,
  "outputCost": 1.2315135367772556,
  "generationSuccessCount": 5,
  "inputTokens": 0,
  "generationErrorCount": 2,
  "thumbsDown": 9,
  "judgeToxicity": 0.6846853,
  "totalTokens": 1,
  "judgeAccuracy": 0.10246457,
  "generationCount": 5,
  "timeToFirstTokenMs": 2,
  "outputTokens": 6,
  "thumbsUp": 7,
  "durationMs": 3,
  "satisfactionRating": 0.4145608
}