Skip to content
OATSCHEMA

Docs / Schemas / llm-output / 0.3.0

LLM Output 0.3.0

Store a single interaction with an LLM (a Prompt/Response pair). Captures the input prompt, the resulting output, and the configuration parameters used at that moment.

This is an older version of llm-output.

The latest version is 0.8.0. Releases before 0.7.0 use the $id https://dorsalhub.com/schemas/open/llm-output and are served by DorsalHub.

$id
https://dorsalhub.com/schemas/open/llm-output
Latest
https://oatschema.org/llm-output
Versions
Source
v0.3.0 on GitHub

Schema

llm-output.json Raw 
{    "x-license": {        "id": "Apache-2.0",        "notice": "Copyright 2025-2026 Dorsal Hub LTD",        "url": "https://github.com/dorsalhub/open-validation-schemas/blob/main/LICENSE"    },    "$schema": "https://json-schema.org/draft/2020-12/schema",    "$id": "https://dorsalhub.com/schemas/open/llm-output",    "title": "LLM Output",    "version": "0.3.0",    "description": "Store a single interaction with an LLM (a Prompt/Response pair). Captures the input prompt, the resulting output, and the configuration parameters used at that moment.",    "type": "object",    "properties": {        "model": {            "type": "string",            "description": "The ID or name of the model used (e.g., 'gpt-4o', 'claude-3-sonnet').",            "maxLength": 1024        },        "prompt": {            "type": "string",            "description": "The text input provided to the model. For contexts exceeding the character limit, this field should be truncated or a reference to the full storage location.",            "maxLength": 262144        },        "response_data": {            "description": "The output from the model. Non-plaintext output (e.g. JSON) should be serialized. For contexts exceeding the character limit, this field should be truncated or a reference to the full storage location.",            "type": "string",            "maxLength": 524288        },        "language": {            "type": "string",            "description": "The 3-letter ISO-639-3 language code of the response (e.g., 'eng', 'fra').",            "pattern": "^[a-z]{3}$",            "maxLength": 3        },        "score": {            "type": "number",            "description": "A normalized metric evaluating the response (-1.0 to 1.0). Positive values indicate high quality, acceptance, or positive sentiment. Negative values indicate rejection, low quality, or negative sentiment.",            "minimum": -1,            "maximum": 1        },        "score_explanation": {            "type": "string",            "description": "Defines the meaning and range of the 'score' field (e.g. 'Reward Model Score' or 'Confidence').",            "maxLength": 256        },        "generation_params": {            "type": "object",            "description": "Optional parameters sent in the API request to control the generation.",            "properties": {                "system_prompt": {                    "type": "string",                    "description": "An optional system-level instruction that defines the model's persona, style, or constraints.",                    "maxLength": 4096                },                "temperature": {                    "type": "number",                    "description": "Controls randomness (e.g., 0.0 to 2.0).",                    "minimum": 0,                    "maximum": 2                },                "top_p": {                    "type": "number",                    "description": "Controls nucleus sampling (e.g., 0.0 to 1.0).",                    "minimum": 0,                    "maximum": 1                },                "max_tokens": {                    "type": "integer",                    "description": "The maximum number of tokens that were allowed to be generated.",                    "minimum": 1                },                "seed": {                    "type": "integer",                    "description": "The seed used for sampling for reproducible outputs."                },                "stop": {                    "type": [                        "string",                        "array"                    ],                    "description": "One or more sequences where the API will stop generating further tokens.",                    "maxLength": 128,                    "items": {                        "type": "string",                        "maxLength": 128                    },                    "maxItems": 16                },                "presence_penalty": {                    "type": "number",                    "description": "Penalty for new tokens based on whether they appear in the text so far (e.g., -2.0 to 2.0).",                    "minimum": -2,                    "maximum": 2                },                "frequency_penalty": {                    "type": "number",                    "description": "Penalty for new tokens based on their existing frequency in the text so far (e.g., -2.0 to 2.0).",                    "minimum": -2,                    "maximum": 2                },                "response_format": {                    "type": "object",                    "description": "Specifies the output format (e.g., 'text' or 'json_object').",                    "properties": {                        "type": {                            "type": "string",                            "description": "The type of output format.",                            "enum": [                                "text",                                "json_object"                            ]                        }                    },                    "required": [                        "type"                    ],                    "additionalProperties": false                }            },            "additionalProperties": false        },        "generation_metadata": {            "type": "object",            "description": "Optional metadata returned by the API response, used for provenance and logging.",            "properties": {                "response_id": {                    "type": "string",                    "description": "The unique identifier for the generation response from the API provider.",                    "maxLength": 128                },                "created": {                    "type": "string",                    "format": "date-time",                    "maxLength": 128,                    "description": "The ISO-8601 timestamp of when the response was created."                },                "finish_reason": {                    "type": "string",                    "description": "The reason the model stopped generating tokens (e.g., 'stop', 'length', 'tool_calls').",                    "maxLength": 128                },                "system_fingerprint": {                    "type": "string",                    "description": "An identifier for the backend configuration that served the request, for reproducibility.",                    "maxLength": 128                },                "usage": {                    "type": "object",                    "description": "Token usage statistics for the generation request.",                    "properties": {                        "prompt_tokens": {                            "type": "integer",                            "minimum": 0                        },                        "completion_tokens": {                            "type": "integer",                            "minimum": 0                        },                        "total_tokens": {                            "type": "integer",                            "minimum": 0                        }                    },                    "required": [                        "prompt_tokens",                        "completion_tokens",                        "total_tokens"                    ],                    "additionalProperties": false                }            },            "additionalProperties": false        },        "attributes": {            "type": "object",            "description": "Arbitrary metadata relevant to this item.",            "maxProperties": 16,            "additionalProperties": {                "anyOf": [                    {                        "type": "string",                        "maxLength": 1024                    },                    {                        "type": "number"                    },                    {                        "type": "boolean"                    },                    {                        "type": "null"                    }                ]            }        }    },    "required": [        "model",        "response_data"    ],    "additionalProperties": false}

Fields

  • model string required

    The ID or name of the model used (e.g., 'gpt-4o', 'claude-3-sonnet').

    • at most 1024 characters
  • prompt string

    The text input provided to the model. For contexts exceeding the character limit, this field should be truncated or a reference to the full storage location.

    • at most 262144 characters
  • response_data string required

    The output from the model. Non-plaintext output (e.g. JSON) should be serialized. For contexts exceeding the character limit, this field should be truncated or a reference to the full storage location.

    • at most 524288 characters
  • language string

    The 3-letter ISO-639-3 language code of the response (e.g., 'eng', 'fra').

    • at most 3 characters
    • matches ^[a-z]{3}$
  • score number

    A normalized metric evaluating the response (-1.0 to 1.0). Positive values indicate high quality, acceptance, or positive sentiment. Negative values indicate rejection, low quality, or negative sentiment.

    • -1 to 1
  • score_explanation string

    Defines the meaning and range of the 'score' field (e.g. 'Reward Model Score' or 'Confidence').

    • at most 256 characters
  • generation_params object

    Optional parameters sent in the API request to control the generation.

    • system_prompt string

      An optional system-level instruction that defines the model's persona, style, or constraints.

      • at most 4096 characters
    • temperature number

      Controls randomness (e.g., 0.0 to 2.0).

      • 0 to 2
    • top_p number

      Controls nucleus sampling (e.g., 0.0 to 1.0).

      • 0 to 1
    • max_tokens integer

      The maximum number of tokens that were allowed to be generated.

      • ≥ 1
    • seed integer

      The seed used for sampling for reproducible outputs.

    • stop ['string', 'array']

      One or more sequences where the API will stop generating further tokens.

      • at most 128 characters
      • at most 16 items
      • each at most 128 characters
    • presence_penalty number

      Penalty for new tokens based on whether they appear in the text so far (e.g., -2.0 to 2.0).

      • -2 to 2
    • frequency_penalty number

      Penalty for new tokens based on their existing frequency in the text so far (e.g., -2.0 to 2.0).

      • -2 to 2
    • response_format object

      Specifies the output format (e.g., 'text' or 'json_object').

      • type string required

        The type of output format.

        Allowed values: "text", "json_object"

  • generation_metadata object

    Optional metadata returned by the API response, used for provenance and logging.

    • response_id string

      The unique identifier for the generation response from the API provider.

      • at most 128 characters
    • created string

      The ISO-8601 timestamp of when the response was created.

      • at most 128 characters
      • format date-time
    • finish_reason string

      The reason the model stopped generating tokens (e.g., 'stop', 'length', 'tool_calls').

      • at most 128 characters
    • system_fingerprint string

      An identifier for the backend configuration that served the request, for reproducibility.

      • at most 128 characters
    • usage object

      Token usage statistics for the generation request.

      • prompt_tokens integer required
        • ≥ 0
      • completion_tokens integer required
        • ≥ 0
      • total_tokens integer required
        • ≥ 0
  • attributes object

    Arbitrary metadata relevant to this item.

    • at most 16 properties
    • * string | number | boolean | null

      Any other key.

      • string: at most 1024 characters

Copyright 2025-2026 Dorsal Hub LTD. Licensed under Apache-2.0.