Conversation
Catalog construction called reasoning helpers for every model and offered a fixed low/medium/high set. Read the loaded model_cost metadata when building model options, derive effort choices from explicit levels and capability flags, and filter known non-text model categories. Honor explicit negative capability metadata and thinking-always-on constraints. Prefer local metadata for runtime validation, retaining the existing capability lookup fallback when metadata is absent. Validation: - 6 LiteLLM provider tests passed with SDK calls mocked. - Ruff lint/format checks and git diff --check passed.
|
Thanks @Selene29, reading the loaded catalog once is the right direction, and keeping There is still one discovery/runtime split in the reasoning path. Please make an indecisive or missing catalog row take the same fallback in both paths, and add a regression with a model present in |
Summary
Problem
LiteLLM discovery offered a fixed
low,medium, andhighset for reasoning models, while execution used a separate capability lookup. The two paths could disagree about which effort values a model accepts.Catalog construction also consulted per-model helpers and included non-text model categories. This change keeps enumeration local, filters those categories, and treats explicit negative or always-on metadata as authoritative.
Testing