feat(ai-gemini): add Google Veo video adapter on the typed-duration contract

[tombeckenham]

🎯 Changes

Closes #634. Stacked on #624 (618-image-to-image-and-image-to-video-support) — this PR targets that branch, adopts its multimodal MediaPrompt format, and should land after it.

Previously stacked on #641 (534-video-duration-support); restacked because #624 is mergeable on current main while the #622→#641 stack still needs a layout rebase, and Veo wants the multimodal prompt (image-to-video is its headline capability). To keep #634's premise — Veo never ships with an untyped duration?: number — this PR carries a minimal additive port of the #534 typed-duration contract. When #641 rebases onto main it shrinks to FAL/OpenAI adoption of this contract (plus any strictness changes).

@tanstack/ai — additive typed-duration contract (minor, non-breaking)

• VideoAdapter / BaseVideoAdapter gain a TModelDurationByName generic. The default (Record<string, number>) preserves today's duration?: number typing for adapters without a map (Sora, fal unchanged).
• availableDurations() → DurationOptions tagged union (discrete | range | mixed | none); default { kind: 'none' }.
• snapDuration(seconds) → closest valid duration; default undefined. snapToDurationOption exported from @tanstack/ai/adapters for adapter authors.
• generateVideo({ duration }) typed per model via VideoDurationForAdapter<TAdapter>.

@tanstack/ai-gemini — Veo adapter (minor)

• GeminiVideoAdapter over @google/genai models.generateVideos (:predictLongRunning) / operations.getVideosOperation; getVideoStatus maps done/error and surfaces all-samples-RAI-filtered as failed with reasons; getVideoUrl returns response.generatedVideos[0].video.uri.
• MediaPrompt image routing (new prompt format): first un-roled / 'start_frame' image → input image, 'end_frame' → lastFrame, 'reference'/'character' → referenceImages (ASSET). Image parts convert from data sources, base64 data: URIs, gs:// URIs, or fetched HTTP URLs. Multiple starting images / video / audio parts throw; 'mask'/'control' roles throw.
• Typed durations: geminiVideo('veo-3.0-generate-001') → duration?: 4 | 6 | 8; Veo 2 → 5 | 6 | 8; snapDuration(7) → 6. size is the aspect ratio ('16:9' | '9:16'); resolution/generateAudio/negativePrompt etc. via modelOptions (vendor GenerateVideosConfig minus adapter-managed fields).
• Veo model-meta entries uncommented + finalized (GEMINI_VIDEO_MODELS union); the stale GeminiGenerationConfigOptions reference replaced with the intersection the Imagen entries use.
• 25 unit tests (client stub injected via the protected client seam) including expectTypeOf compile-time duration assertions and MediaPrompt routing coverage.

E2E, docs, skill

• 'gemini' added to video-gen; global-setup.ts mounts Veo's :predictLongRunning + operations-poll endpoints (aimock 1.29 doesn't model the long-running pair), responding with the raw MLDev wire shape the SDK normalizes. All three transports pass; openai video-gen + image-to-video suites still green. Gemini stays out of the image-to-video e2e set — that spec's journal assertion is tied to aimock's /v1/videos pipeline, which custom mounts bypass; Veo's image routing is unit-tested (noted in feature-support.ts).
• docs/media/video-generation.md: Veo section (typed durations table, snapDuration example, download-auth note); role-hint and provider-support tables updated from "Veo planned" to actual mappings.
• media-generation SKILL.md updated alongside.

Duration values vs the issue

The issue's table said Veo 3.x = 4 | 8, Veo 2 = 5–8, and asked to confirm before locking. Current official Veo docs say Veo 3.x: 4 | 6 | 8, Veo 2: 5 | 6 | 8 — those shipped, so snapDuration(7) returns 6 (not 8 as the issue's acceptance line assumed). Live API confirmation was attempted via free invalid-duration probes but the key's prepaid credits are depleted (429 before validation); docs are the source of truth. (Also note durationSeconds is a number in the Gemini API, unlike Sora's string seconds, and the issue's packages/typescript/… paths predate the repo restructure.)

✅ Checklist

• I have followed the steps in the Contributing guide.
• I have tested this code locally with pnpm run test:pr.

🚀 Release Impact

• This change affects published code, and I have generated a changeset.
• This change is docs/CI/dev-only (no release).

🤖 Generated with Claude Code

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: baa12935-2db8-447e-b563-0d30060d7127

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch 634-featgemini-add-google-veo-video-adapter-on-the-typed-duration-contract

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[github-actions]

🚀 Changeset Version Preview

4 package(s) bumped directly, 27 bumped as dependents.

🟥 Major bumps

Package	Version	Reason
@tanstack/ai	0.21.3 → 1.0.0	Changeset
@tanstack/ai-fal	0.7.13 → 1.0.0	Changeset
@tanstack/ai-gemini	0.10.10 → 1.0.0	Changeset
@tanstack/ai-anthropic	0.10.3 → 1.0.0	Dependent
@tanstack/ai-code-mode	0.1.20 → 1.0.0	Dependent
@tanstack/ai-code-mode-skills	0.1.20 → 1.0.0	Dependent
@tanstack/ai-elevenlabs	0.2.10 → 1.0.0	Dependent
@tanstack/ai-event-client	0.3.10 → 1.0.0	Dependent
@tanstack/ai-grok	0.8.7 → 1.0.0	Dependent
@tanstack/ai-groq	0.2.6 → 1.0.0	Dependent
@tanstack/ai-isolate-node	0.1.20 → 1.0.0	Dependent
@tanstack/ai-isolate-quickjs	0.1.20 → 1.0.0	Dependent
@tanstack/ai-ollama	0.6.21 → 1.0.0	Dependent
@tanstack/ai-openai	0.10.0 → 1.0.0	Dependent
@tanstack/ai-openrouter	0.9.7 → 1.0.0	Dependent
@tanstack/ai-preact	0.6.32 → 1.0.0	Dependent
@tanstack/ai-react	0.11.7 → 1.0.0	Dependent
@tanstack/ai-react-ui	0.8.1 → 1.0.0	Dependent
@tanstack/ai-solid	0.10.7 → 1.0.0	Dependent
@tanstack/ai-solid-ui	0.7.1 → 1.0.0	Dependent
@tanstack/ai-svelte	0.10.7 → 1.0.0	Dependent
@tanstack/ai-vue	0.10.8 → 1.0.0	Dependent
@tanstack/openai-base	0.3.6 → 1.0.0	Dependent

🟨 Minor bumps

Package	Version	Reason
@tanstack/ai-schemas	0.1.0 → 0.2.0	Changeset

🟩 Patch bumps

Package	Version	Reason
@tanstack/ai-client	0.11.7 → 0.11.8	Dependent
@tanstack/ai-devtools-core	0.3.37 → 0.3.38	Dependent
@tanstack/ai-isolate-cloudflare	0.2.11 → 0.2.12	Dependent
@tanstack/ai-vue-ui	0.2.3 → 0.2.4	Dependent
@tanstack/preact-ai-devtools	0.1.41 → 0.1.42	Dependent
@tanstack/react-ai-devtools	0.2.41 → 0.2.42	Dependent
@tanstack/solid-ai-devtools	0.2.41 → 0.2.42	Dependent

[nx-cloud]

View your CI Pipeline Execution ↗ for commit 27eaac5

Command	Status	Duration	Result
nx run-many --targets=build --exclude=examples/...	✅ Succeeded	1m 8s	View ↗

---

☁️ Nx Cloud last updated this comment at 2026-06-10 08:55:45 UTC

[pkg-pr-new]

Open in StackBlitz

@tanstack/ai

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai@741

@tanstack/ai-anthropic

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-anthropic@741

@tanstack/ai-client

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-client@741

@tanstack/ai-code-mode

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-code-mode@741

@tanstack/ai-code-mode-skills

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-code-mode-skills@741

@tanstack/ai-devtools-core

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-devtools-core@741

@tanstack/ai-elevenlabs

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-elevenlabs@741

@tanstack/ai-event-client

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-event-client@741

@tanstack/ai-fal

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-fal@741

@tanstack/ai-gemini

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-gemini@741

@tanstack/ai-grok

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-grok@741

@tanstack/ai-groq

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-groq@741

@tanstack/ai-isolate-cloudflare

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-cloudflare@741

@tanstack/ai-isolate-node

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-node@741

@tanstack/ai-isolate-quickjs

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-quickjs@741

@tanstack/ai-ollama

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-ollama@741

@tanstack/ai-openai

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-openai@741

@tanstack/ai-openrouter

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-openrouter@741

@tanstack/ai-preact

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-preact@741

@tanstack/ai-react

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-react@741

@tanstack/ai-react-ui

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-react-ui@741

@tanstack/ai-schemas

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-schemas@741

@tanstack/ai-solid

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-solid@741

@tanstack/ai-solid-ui

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-solid-ui@741

@tanstack/ai-svelte

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-svelte@741

@tanstack/ai-utils

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-utils@741

@tanstack/ai-vue

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-vue@741

@tanstack/ai-vue-ui

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-vue-ui@741

@tanstack/openai-base

npm i https://pkg.pr.new/TanStack/ai/@tanstack/openai-base@741

@tanstack/preact-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/preact-ai-devtools@741

@tanstack/react-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/react-ai-devtools@741

@tanstack/solid-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/solid-ai-devtools@741

commit: 27eaac5