Skip to content

Syncing Model Evaluation fields from gen-ai Public API - #1235

Merged
SSharma-10 merged 2 commits into
digitalocean:mainfrom
aguan-hue:aguan/model-eval-api-field-sync
Sep 30, 2026
Merged

SSharma-10 merged 2 commits into
digitalocean:mainfrom
aguan-hue:aguan/model-eval-api-field-sync

Conversation

@aguan-hue

@aguan-hue aguan-hue commented Sep 24, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Sync recent model-evaluation and evaluation-dataset fields/enums into the public OpenAPI spec to match the live GenAI API. No new endpoints — additive fields only.

Adds

  • Epochs (n-pass) on create/get run request and response, plus epoch result summary types
  • reasoning_effort on candidate inference config
  • Dataset paradigm on create/list dataset schemas, plus dataset_paradigm and has_ground_truth list filters
  • CANDIDATE_MODEL_SOURCE_AGENT
  • METRIC_CATEGORY_CONVERSATIONAL
  • avg@k / pass@k / cons@k fields on metric result summaries

@aguan-hue
aguan-hue marked this pull request as ready for review September 24, 2026 23:28
@SSharma-10
SSharma-10 merged commit 569464c into digitalocean:main Sep 30, 2026
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants