Skip to main content
POST
/
evaluations
/
trace-scores
Create Trace Score
curl --request POST \
  --url https://api.pandaprobe.com/evaluations/trace-scores \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "trace_id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
  "name": "accuracy",
  "value": "0.92"
}
'
{
  "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "trace_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "name": "<string>",
  "value": "<string>",
  "status": "SUCCESS",
  "source": "AUTOMATED",
  "created_at": "<string>",
  "project_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "data_type": "NUMERIC",
  "eval_run_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "author_user_id": "<string>",
  "reason": "<string>",
  "environment": "<string>",
  "config_id": "<string>",
  "metadata": {},
  "updated_at": "<string>"
}

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json

Manually create a trace score (annotation or programmatic).

Used by the dashboard for human annotations or by the SDK for programmatic score submission.

​
trace_id
string<uuid>
required

Trace UUID to attach the score to.

​
name
string
required

Metric/score name (e.g. 'task_completion', 'quality', 'thumbs_up').

​
value
string
required

Score value as string. For NUMERIC: '0.85', for BOOLEAN: 'true', for CATEGORICAL: 'PASS'.

​
data_type
enum<string>
default:NUMERIC

Value type: NUMERIC, BOOLEAN, CATEGORICAL.

Available options:
NUMERIC,
BOOLEAN,
CATEGORICAL
​
source
enum<string>
default:ANNOTATION

Score origin: ANNOTATION (human) or PROGRAMMATIC (SDK).

Available options:
AUTOMATED,
ANNOTATION,
PROGRAMMATIC
​
reason
string | null

Optional explanation or annotation note.

​
metadata
Metadata · object

Optional metadata object.

Response

Successful Response

Full trace score representation used by both list and detail endpoints.

​
id
string<uuid>
required
​
trace_id
string<uuid>
required
​
name
string
required
​
value
string | null
required
​
status
enum<string>
required

Outcome of a trace score evaluation attempt.

Available options:
SUCCESS,
FAILED,
PENDING
​
source
enum<string>
required

Who produced the score judgment (not how it arrived).

AUTOMATED -- the eval system's LLM judge produced this score ANNOTATION -- a human assigned this score manually PROGRAMMATIC -- external code submitted this score via API/SDK

Available options:
AUTOMATED,
ANNOTATION,
PROGRAMMATIC
​
created_at
string
required
​
project_id
string<uuid>
required
​
data_type
enum<string>
required

Data type for a trace score value.

Available options:
NUMERIC,
BOOLEAN,
CATEGORICAL
​
eval_run_id
string<uuid> | null
required
​
author_user_id
string | null
required
​
reason
string | null
required
​
environment
string | null
required
​
config_id
string | null
required
​
metadata
Metadata · object
required
​
updated_at
string
required