Skip to content

Add Claude Haiku 5.5 and honor Claude thinking Off - #135

Merged
wch merged 4 commits into
mainfrom
haiku-5-5
Oct 8, 2026
Merged

wch merged 4 commits into
mainfrom
haiku-5-5

Conversation

@wch

@wch wch commented Oct 7, 2026

Copy link
Copy Markdown
Collaborator

This PR adds Claude Haiku 5.5 to model discovery and capability inference so applications can offer its 1M-token context window, 128K-token output limit, and supported thinking levels. It also makes Claude's “Off” thinking setting disable thinking on models that support it, instead of leave adaptive thinking enabled by default.

The provider library updates the Anthropic, Vertex, and Bedrock SDK minimum versions together and uses one thinking-options implementation across Anthropic, Bedrock, Google Vertex, Snowflake, and Posit AI Pass. Active effort levels request adaptive thinking with visible summaries; provider-default requests leave the thinking mode and effort unspecified. Existing route-specific tool-streaming options remain intact.

Haiku 5.5 offers “off,” “low,” “medium,” “high,” “xhigh,” and “max.” “Off” sends an explicit disable request without an effort value, avoiding the incompatible combination of disabled thinking and the highest effort levels. Claude models that cannot disable thinking still do not offer “Off.” Model metadata recognizes bare IDs and supported provider prefixes, and Vertex displays the undated model as “Claude Haiku 5.5.”

Availability still depends on the provider. Snowflake's catalog is unchanged because Cortex does not list Haiku 5.5; the Posit AI Pass gateway is not assumed to serve it merely because the capability rule exists.

Verification

Regression coverage checks capability inference for provider-prefixed IDs, Vertex display names, thinking options on all five Claude routes, and actual Anthropic SDK request serialization for provider-default, disabled, and active thinking. Implementation verification recorded in the companion plan also covers live Anthropic and Bedrock requests; live Vertex verification remains untested because Google credentials were unavailable.

wch added 4 commits October 7, 2026 18:55
Raise floors to @ai-sdk/anthropic ^3.0.128, @ai-sdk/google-vertex ^4.0.211,
and @ai-sdk/amazon-bedrock ^4.0.192. These pin @ai-sdk/provider 3.0.18 and
provider-utils 4.0.57, so the rest of the AI SDK family moves with them to
keep a single copy of the branded packages.
Haiku 5.5 has a 1M context window and 128k max output. Adaptive thinking
is on by default, but unlike Sonnet/Opus 5.5 it accepts
`thinking: {type: "disabled"}`, so the rule offers "off" alongside the
full effort range. The rule precedes the Haiku 4.5 rule.

Add the model to Anthropic's supplemental list until /v1/models returns
it, and cover Vertex display-name derivation for an undated Claude ID.
Snowflake Cortex does not list the model yet, so its catalog is unchanged.
"off" used to omit `thinking`, which on models whose default is adaptive
thinking (Haiku 5.5, Opus 5) left thinking on at the model's default
effort. "off" now sends `thinking: {type: "disabled"}` with no effort;
capability rules offer "off" only on models that accept it.

The five Claude-wire clients (Anthropic, Bedrock, Vertex, Snowflake,
Posit AI) each inlined the same adaptive-thinking options. They now share
`anthropicProviderOptions`, which maps undefined effort to no thinking
config, "off" to disabled, and any level to summarized adaptive thinking,
and merges client options such as `toolStreaming: false` on top.

Final-wire tests run the real SDK serializer for Haiku 5.5, Opus 5, and
Opus 4.8; routing tests cover the other four clients.
@wch
wch merged commit 4886628 into main Oct 8, 2026
4 checks passed
@wch
wch deleted the haiku-5-5 branch October 8, 2026 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant