Ruslan/sync with evals

[newokaerinasai]

This PR

Syncs the evaluation endpoints with openapi from the repo

How to test

Swagger outputs the following:

This list of endpoints corresponds to what we have. Visual inspection also confirms parameters are correct

---

Note

Syncs Evaluation endpoints in OpenAPI by adding /evaluation CRUD and model-list routes, deprecating legacy /evaluations*, and refining params, enums, and response schemas.

• Evaluation API:
  • New/Updated routes:
    • POST /evaluation → create job (EvaluationTypedRequest → EvaluationResponse).
    • GET /evaluation → list jobs with status (default pending), limit (default 10), optional userId.
    • GET /evaluation/{id} → job details (EvaluationJob).
    • GET /evaluation/{id}/status → job status/results (status enum, results oneOf classify/score/compare).
    • POST /evaluation/{id}/update → update job status, results, optional error.
    • GET /evaluation/model-list → model list.
  • Deprecations:
    • GET /evaluations and GET /evaluations/model-list kept with deprecation notes and updated responses/params.
  • Schema/metadata tweaks:
    • Unified tags to evaluation and updated operationIds.
    • Clarified response descriptions; set default query param values; tightened status enums and results shapes.

^{Written by Cursor Bugbot for commit 2fe7421. This will update automatically on new commits. Configure here.}

[github-actions]

✱ Stainless preview builds

This PR will update the togetherai SDKs with the following commit message.

feat: Ruslan/sync with evals

Edit this comment to update it. It will appear in the SDK's changelogs.

⚠️ togetherai-typescript studio · code · diff

There was a regression in your SDK.
generate ⚠️ → build ✅ → lint ✅ → test ❗ (prev: test ✅)

npm install https://pkg.stainless.com/s/togetherai-typescript/f85961c2422c0038d24b7c4d4cc6fedc5410fa58/dist.tar.gz

New diagnostics (2 warning, 3 note)

⚠️ Endpoint/NotConfigured: `get /evaluations` exists in the OpenAPI spec, but isn't specified in the Stainless config, so code will not be generated for it.

⚠️ Python/NameNotAllowed: Encountered response property `model_list` which may conflict with Pydantic properties. Pydantic uses model_ as a protected namespace that shouldn't be used for attributes of our own API's models. Please rename it using the 'renameValue' transform.

💡 Schema/ObjectHasNoProperties: This schema has neither `properties` nor `additionalProperties` so its type has been interpreted as `unknown`.

💡 Schema/EnumHasOneMember: This enum schema has just one member, so it could be defined using [`const`](https://json-schema.org/understanding-json-schema/reference/const).

💡 Go/SchemaUnionDiscriminatorMissing: This union schema has more than one object variant, but no [`discriminator`](https://www.stainless.com/docs/reference/openapi-support#discriminator) property, so deserializing the union may be inefficient or ambiguous.

⚠️ togetherai-go studio · code · diff

There was a regression in your SDK.
generate ⚠️ → lint ✅ → test ❗ (prev: test ✅)

go get github.com/stainless-sdks/togetherai-go@ff3952f16e69956f873bdacb427abcaa4023531f

New diagnostics (1 warning, 3 note)

⚠️ Endpoint/NotConfigured: `get /evaluations` exists in the OpenAPI spec, but isn't specified in the Stainless config, so code will not be generated for it.

💡 Schema/ObjectHasNoProperties: This schema has neither `properties` nor `additionalProperties` so its type has been interpreted as `unknown`.

💡 Schema/EnumHasOneMember: This enum schema has just one member, so it could be defined using [`const`](https://json-schema.org/understanding-json-schema/reference/const).

💡 Go/SchemaUnionDiscriminatorMissing: This union schema has more than one object variant, but no [`discriminator`](https://www.stainless.com/docs/reference/openapi-support#discriminator) property, so deserializing the union may be inefficient or ambiguous.

⚠️ togetherai-python studio · conflict

There was a regression in your SDK.

New diagnostics (2 warning, 3 note)

⚠️ Endpoint/NotConfigured: `get /evaluations` exists in the OpenAPI spec, but isn't specified in the Stainless config, so code will not be generated for it.

⚠️ Python/NameNotAllowed: Encountered response property `model_list` which may conflict with Pydantic properties. Pydantic uses model_ as a protected namespace that shouldn't be used for attributes of our own API's models. Please rename it using the 'renameValue' transform.

💡 Schema/ObjectHasNoProperties: This schema has neither `properties` nor `additionalProperties` so its type has been interpreted as `unknown`.

💡 Schema/EnumHasOneMember: This enum schema has just one member, so it could be defined using [`const`](https://json-schema.org/understanding-json-schema/reference/const).

💡 Go/SchemaUnionDiscriminatorMissing: This union schema has more than one object variant, but no [`discriminator`](https://www.stainless.com/docs/reference/openapi-support#discriminator) property, so deserializing the union may be inefficient or ambiguous.

⚠️ togetherai-terraform studio · code · diff

There was a regression in your SDK.
generate ❗ → lint ❗ → test ❗

New diagnostics (2 warning, 3 note)

⚠️ Endpoint/NotConfigured: `get /evaluations` exists in the OpenAPI spec, but isn't specified in the Stainless config, so code will not be generated for it.

⚠️ Python/NameNotAllowed: Encountered response property `model_list` which may conflict with Pydantic properties. Pydantic uses model_ as a protected namespace that shouldn't be used for attributes of our own API's models. Please rename it using the 'renameValue' transform.

💡 Schema/ObjectHasNoProperties: This schema has neither `properties` nor `additionalProperties` so its type has been interpreted as `unknown`.

💡 Schema/EnumHasOneMember: This enum schema has just one member, so it could be defined using [`const`](https://json-schema.org/understanding-json-schema/reference/const).

💡 Go/SchemaUnionDiscriminatorMissing: This union schema has more than one object variant, but no [`discriminator`](https://www.stainless.com/docs/reference/openapi-support#discriminator) property, so deserializing the union may be inefficient or ambiguous.

---

This comment is auto-generated by GitHub Actions and is automatically kept up to date as you push.
Last updated: 2025-11-10 11:38:46 UTC

[cursor]

This is the final PR Bugbot will review for you during this billing cycle

Your free Bugbot reviews will reset on December 7

Details

Your team is on the Bugbot Free tier. On this plan, Bugbot will review limited PRs each billing cycle for each member of your team.

To receive Bugbot reviews on all of your PRs, visit the Cursor dashboard to activate Pro and start your 14-day free trial.