Skip to content

Add first-class verbosity support for GPT-5 #1403

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

zaingz
Copy link

@zaingz zaingz commented Aug 8, 2025

Summary

Adds first-class verbosity support for GPT-5 across both OpenAI Responses and Chat Completions backends.

  • New field: ModelSettings.verbosity: Literal["low","medium","high"] | None.
  • Responses API: verbosity is merged into text config as text.verbosity, coexisting with JSON schema response format when provided.
  • Chat Completions API: verbosity is forwarded via extra_body until official client types surface it as a top-level param.
  • Reasoning effort remains fully supported; Reasoning(effort="minimal") maps to reasoning (Responses) and reasoning_effort (Chat Completions).

Test plan

  • Ran make format, make lint: OK.
  • make mypy: OK after installing dev/extras via make sync (installs numpy, litellm, etc.).
  • Test run locally was constrained by this environment; CI should run the full suite with extras. Manual verification included:
    • Responses path: ModelSettings(verbosity="low") produces a text payload with { "verbosity": "low" }, merged with JSON schema when present.
    • Chat Completions: ModelSettings(verbosity="low") appears under request extra_body and reaches the client call.

Issue number

N/A (please link if there’s a tracking issue).

Checks

  • I've run make lint and make format
  • I've added new tests (if relevant)
  • I've added/updated the relevant documentation
  • I've made sure tests pass

…delSettings.verbosity (low|medium|high)\n- Responses: send as text.verbosity (merged with format)\n- Chat Completions: send via extra_body for now\n- Preserve existing reasoning support incl. minimal effort\n\nDocs: behavior is aligned with GPT-5 guide; will follow up with docs/tests if needed.
@serialx
Copy link

serialx commented Aug 13, 2025

I believe 0.2.6 already implements GPT-5 related features.

@seratch
Copy link
Member

seratch commented Aug 13, 2025

The verbosity parameter is not yet available in ModelSettings while you can pass it as part of extra_args. We will resolve this soon.

@seratch
Copy link
Member

seratch commented Aug 15, 2025

Thanks again for taking the time to send this. This was resolved by #1439

@seratch seratch closed this Aug 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants