Skip to content

chore: add activity-coverage dimension to gap-analysis skill#744

Merged
AlemTuzlak merged 2 commits into
mainfrom
chore/gap-analysis-activity-coverage
Jun 11, 2026
Merged

chore: add activity-coverage dimension to gap-analysis skill#744
AlemTuzlak merged 2 commits into
mainfrom
chore/gap-analysis-activity-coverage

Conversation

@tombeckenham

@tombeckenham tombeckenham commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🎯 Changes

Updates the gap-analysis maintainer skill (.claude/skills/gap-analysis/) with a new activity coverage audit dimension:

  • New activities invocation scope: a fast mechanical diff of which of the 7 core activity kinds (text, summarize, image, audio, video, tts, transcription — the AdapterKind union in packages/ai/src/activities/index.ts) each provider ships an adapter for, vs. what upstream offers.
  • Dimension 6 added to the audit checklist, including the filename→activity-kind map, a real-gap vs. ❌-by-design rubric, and priority guidance. Handled centrally by the orchestrator (no subagent fan-out) since it's derived from a one-shot adapter-file listing.
  • Report template gains a provider×activity grid section with a per-gap bullet format.
  • --all sweep rolls dimension 6 in; subagent dispatch prompt updated to skip it (orchestrator builds the grid).

Skill-only change — no source code, docs pages, or published packages touched.

✅ Checklist

  • I have followed the steps in the Contributing guide.
  • I have tested this code locally with pnpm run test:pr. (N/A — markdown-only skill change, no code affected)

🚀 Release Impact

  • This change affects published code, and I have generated a changeset.
  • This change is docs/CI/dev-only (no release).

🤖 Generated with Claude Code

Summary by CodeRabbit

  • Documentation
    • Added an "Activity coverage" audit dimension and expanded gap-analysis docs to include activity-kind definitions and a provider×activity checklist.
    • Updated audit procedures to clarify orchestrator vs per-provider behavior when building activity coverage and verifying upstream offerings.
    • Updated report templates with an "Activity coverage" section and missing-activity entry patterns for consistent reporting.

Adds a sixth audit dimension (and an `activities` invocation scope) that
diffs which of the 7 core activity kinds each provider ships an adapter
for against what upstream offers, with a provider×activity grid in the
report template.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 13ebe45f-570b-4260-93f3-13408e81cbab

📥 Commits

Reviewing files that changed from the base of the PR and between 030a6cb and 10c8ebb.

📒 Files selected for processing (3)
  • .claude/skills/gap-analysis/SKILL.md
  • .claude/skills/gap-analysis/references/audit-checklist.md
  • .claude/skills/gap-analysis/references/report-template.md
✅ Files skipped from review due to trivial changes (3)
  • .claude/skills/gap-analysis/references/report-template.md
  • .claude/skills/gap-analysis/SKILL.md
  • .claude/skills/gap-analysis/references/audit-checklist.md

📝 Walkthrough

Walkthrough

This PR documents a new "Activity coverage" dimension (Dimension 6) for the gap-analysis skill: it defines seven adapter activity kinds, maps adapter filenames to activity kinds, prescribes an audit checklist for provider×activity coverage, adjusts orchestrator/subagent responsibilities, and updates the report template.

Changes

Activity Coverage Dimension for Gap-Analysis Skill

Layer / File(s) Summary
Activity specification and invocation scopes
.claude/skills/gap-analysis/SKILL.md
Added activities as a new invocation scope; introduced "Known activities (7)" defining text, summarize, image, audio, video, tts, transcription and the adapter filename→activity-kind mapping (notes cost.ts is not an activity adapter).
Activity coverage audit checklist dimension 6
.claude/skills/gap-analysis/references/audit-checklist.md
Added dimension 6: build provider×activity coverage grid from adapter files, classify gaps (real / by-design / stale), and render prioritized gap bullets with upstream URL evidence.
Workflow and subagent orchestration
.claude/skills/gap-analysis/SKILL.md, .claude/skills/gap-analysis/references/audit-checklist.md
Renumbered "Activity coverage" to dimension 6 and delegated grid construction and missing-cell upstream verification to the orchestrator; updated subagent dispatch to skip dimension 6 and cross-provider parity while still emitting per-provider dimension-5 telemetry.
Activity coverage section in report template
.claude/skills/gap-analysis/references/report-template.md
Added "Activity coverage" report section with a provider-by-activity presence table template, legend for ✅/❌/—, and a reusable "missing activity" gap template referencing upstream evidence, current adapter absence, suggested adapter naming, and effort.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

Possibly related PRs

  • TanStack/ai#571: Related changes to gap-analysis maintainer skill docs and subagent/orchestrator audit behavior definitions.

Suggested reviewers

  • AlemTuzlak

Poem

🐰 Seven adapters lined up in a row,
Filenames hinting at what they know,
The orchestrator checks gaps high and low,
Subagents skip what the center must show,
Hooray — coverage blossoms, code gardens grow! 🌱

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: adding an activity-coverage dimension to the gap-analysis skill documentation.
Description check ✅ Passed The PR description covers all key template sections with sufficient detail: changes explain the new dimension and scope, the checklist is appropriately completed, and release impact is correctly marked as docs/CI-only.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/gap-analysis-activity-coverage

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions

github-actions Bot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🚀 Changeset Version Preview

6 package(s) bumped directly, 25 bumped as dependents.

🟥 Major bumps

Package Version Reason
@tanstack/ai-event-client 0.5.4 → 1.0.0 Changeset
@tanstack/ai-fal 0.7.23 → 1.0.0 Changeset
@tanstack/ai-gemini 0.15.1 → 1.0.0 Changeset
@tanstack/ai-openai 0.14.1 → 1.0.0 Changeset
@tanstack/ai-anthropic 0.15.1 → 1.0.0 Dependent
@tanstack/ai-code-mode 0.2.5 → 1.0.0 Dependent
@tanstack/ai-code-mode-skills 0.2.5 → 1.0.0 Dependent
@tanstack/ai-elevenlabs 0.2.20 → 1.0.0 Dependent
@tanstack/ai-grok 0.11.2 → 1.0.0 Dependent
@tanstack/ai-groq 0.4.2 → 1.0.0 Dependent
@tanstack/ai-isolate-node 0.1.30 → 1.0.0 Dependent
@tanstack/ai-isolate-quickjs 0.1.30 → 1.0.0 Dependent
@tanstack/ai-ollama 0.8.1 → 1.0.0 Dependent
@tanstack/ai-openrouter 0.13.1 → 1.0.0 Dependent
@tanstack/ai-preact 0.9.4 → 1.0.0 Dependent
@tanstack/ai-react 0.15.4 → 1.0.0 Dependent
@tanstack/ai-react-ui 0.8.6 → 1.0.0 Dependent
@tanstack/ai-solid 0.13.4 → 1.0.0 Dependent
@tanstack/ai-solid-ui 0.7.6 → 1.0.0 Dependent
@tanstack/ai-svelte 0.13.4 → 1.0.0 Dependent
@tanstack/ai-vue 0.13.4 → 1.0.0 Dependent
@tanstack/openai-base 0.8.1 → 1.0.0 Dependent

🟨 Minor bumps

Package Version Reason
@tanstack/ai 0.28.0 → 0.29.0 Changeset
@tanstack/ai-client 0.16.3 → 0.17.0 Changeset

🟩 Patch bumps

Package Version Reason
@tanstack/ai-devtools-core 0.4.8 → 0.4.9 Dependent
@tanstack/ai-isolate-cloudflare 0.2.21 → 0.2.22 Dependent
@tanstack/ai-mcp 0.1.0 → 0.1.1 Dependent
@tanstack/ai-vue-ui 0.2.16 → 0.2.17 Dependent
@tanstack/preact-ai-devtools 0.1.51 → 0.1.52 Dependent
@tanstack/react-ai-devtools 0.2.51 → 0.2.52 Dependent
@tanstack/solid-ai-devtools 0.2.51 → 0.2.52 Dependent

@nx-cloud

nx-cloud Bot commented Jun 11, 2026

Copy link
Copy Markdown

View your CI Pipeline Execution ↗ for commit 030a6cb

Command Status Duration Result
nx run-many --targets=build --exclude=examples/... ✅ Succeeded 1s View ↗

☁️ Nx Cloud last updated this comment at 2026-06-11 00:49:39 UTC

@tombeckenham tombeckenham requested a review from AlemTuzlak June 11, 2026 00:49
@pkg-pr-new

pkg-pr-new Bot commented Jun 11, 2026

Copy link
Copy Markdown

Open in StackBlitz

@tanstack/ai

npm i https://pkg.pr.new/@tanstack/ai@744

@tanstack/ai-anthropic

npm i https://pkg.pr.new/@tanstack/ai-anthropic@744

@tanstack/ai-client

npm i https://pkg.pr.new/@tanstack/ai-client@744

@tanstack/ai-code-mode

npm i https://pkg.pr.new/@tanstack/ai-code-mode@744

@tanstack/ai-code-mode-skills

npm i https://pkg.pr.new/@tanstack/ai-code-mode-skills@744

@tanstack/ai-devtools-core

npm i https://pkg.pr.new/@tanstack/ai-devtools-core@744

@tanstack/ai-elevenlabs

npm i https://pkg.pr.new/@tanstack/ai-elevenlabs@744

@tanstack/ai-event-client

npm i https://pkg.pr.new/@tanstack/ai-event-client@744

@tanstack/ai-fal

npm i https://pkg.pr.new/@tanstack/ai-fal@744

@tanstack/ai-gemini

npm i https://pkg.pr.new/@tanstack/ai-gemini@744

@tanstack/ai-grok

npm i https://pkg.pr.new/@tanstack/ai-grok@744

@tanstack/ai-groq

npm i https://pkg.pr.new/@tanstack/ai-groq@744

@tanstack/ai-isolate-cloudflare

npm i https://pkg.pr.new/@tanstack/ai-isolate-cloudflare@744

@tanstack/ai-isolate-node

npm i https://pkg.pr.new/@tanstack/ai-isolate-node@744

@tanstack/ai-isolate-quickjs

npm i https://pkg.pr.new/@tanstack/ai-isolate-quickjs@744

@tanstack/ai-mcp

npm i https://pkg.pr.new/@tanstack/ai-mcp@744

@tanstack/ai-ollama

npm i https://pkg.pr.new/@tanstack/ai-ollama@744

@tanstack/ai-openai

npm i https://pkg.pr.new/@tanstack/ai-openai@744

@tanstack/ai-openrouter

npm i https://pkg.pr.new/@tanstack/ai-openrouter@744

@tanstack/ai-preact

npm i https://pkg.pr.new/@tanstack/ai-preact@744

@tanstack/ai-react

npm i https://pkg.pr.new/@tanstack/ai-react@744

@tanstack/ai-react-ui

npm i https://pkg.pr.new/@tanstack/ai-react-ui@744

@tanstack/ai-solid

npm i https://pkg.pr.new/@tanstack/ai-solid@744

@tanstack/ai-solid-ui

npm i https://pkg.pr.new/@tanstack/ai-solid-ui@744

@tanstack/ai-svelte

npm i https://pkg.pr.new/@tanstack/ai-svelte@744

@tanstack/ai-utils

npm i https://pkg.pr.new/@tanstack/ai-utils@744

@tanstack/ai-vue

npm i https://pkg.pr.new/@tanstack/ai-vue@744

@tanstack/ai-vue-ui

npm i https://pkg.pr.new/@tanstack/ai-vue-ui@744

@tanstack/openai-base

npm i https://pkg.pr.new/@tanstack/openai-base@744

@tanstack/preact-ai-devtools

npm i https://pkg.pr.new/@tanstack/preact-ai-devtools@744

@tanstack/react-ai-devtools

npm i https://pkg.pr.new/@tanstack/react-ai-devtools@744

@tanstack/solid-ai-devtools

npm i https://pkg.pr.new/@tanstack/solid-ai-devtools@744

commit: 10c8ebb

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

Caution

Some comments are outside the diff and can’t be posted inline due to platform limitations.

⚠️ Outside diff range comments (1)
.claude/skills/gap-analysis/references/report-template.md (1)

6-11: ⚠️ Potential issue | 🟠 Major | ⚡ Quick win

Add missing activities scope to the list.

The scope list is incomplete. SKILL.md line 60-61 defines activities as a valid scope (e.g., .agent/gap-analysis/YYYY-MM-DD-activities.md), but this template omits it.

📝 Proposed fix
 - `<provider>` — e.g. `openai`
 - `feature-<feature>` — e.g. `feature-tts`
 - `models`
+- `activities`
 - `all`
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.claude/skills/gap-analysis/references/report-template.md around lines 6 -
11, Update the `<scope>` enumeration in the report-template to include the
missing `activities` scope; specifically add `activities` (matching SKILL.md's
example usage like `.agent/gap-analysis/YYYY-MM-DD-activities.md`) alongside
`provider`, `feature-<feature>`, `models`, and `all` so the template and
SKILL.md remain consistent.
🧹 Nitpick comments (1)
.claude/skills/gap-analysis/references/report-template.md (1)

98-118: ⚡ Quick win

Consider clarifying the report section scope applicability.

The activity coverage section will appear in reports for activities scope and --all scope, but not for single-provider or feature or models scopes. Consider adding a note (similar to line 83's "Per dimension 5") that explicitly states when this section should be included, to help maintainers know when to drop it per line 13's guidance.

📝 Suggested addition
 ## Activity coverage
 
-> Per dimension 6 in audit-checklist.md. Which of the 7 core activity kinds
+> Per dimension 6 in audit-checklist.md (included in `activities` and `--all` scopes only). Which of the 7 core activity kinds
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.claude/skills/gap-analysis/references/report-template.md around lines 98 -
118, The "Activity coverage" section (heading "Activity coverage" and the "Per
dimension 6" reference) should explicitly state when it is included in generated
reports: add a short note under the heading (similar to the existing "Per
dimension 5" note on the template) clarifying that this section is shown for the
"activities" scope and when "--all" is used, and that it should be omitted for
"single-provider", "feature", and "models" scopes; update the template text
immediately above the table so maintainers know when to keep or drop this
section.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.claude/skills/gap-analysis/references/report-template.md:
- Line 109: Update the legend line that currently reads "Legend: ✅ adapter
shipped · ❌ upstream offers it, no adapter (gap) · — upstream doesn't offer it
(by design)." so it matches the audit checklist's notation by replacing the em
dash item with the "❌-by-design" token used in audit-checklist.md; ensure the
legend contains "❌-by-design" (or the exact token used in audit-checklist.md)
instead of "— upstream doesn't offer it (by design)" so both documents use the
same notation.

---

Outside diff comments:
In @.claude/skills/gap-analysis/references/report-template.md:
- Around line 6-11: Update the `<scope>` enumeration in the report-template to
include the missing `activities` scope; specifically add `activities` (matching
SKILL.md's example usage like `.agent/gap-analysis/YYYY-MM-DD-activities.md`)
alongside `provider`, `feature-<feature>`, `models`, and `all` so the template
and SKILL.md remain consistent.

---

Nitpick comments:
In @.claude/skills/gap-analysis/references/report-template.md:
- Around line 98-118: The "Activity coverage" section (heading "Activity
coverage" and the "Per dimension 6" reference) should explicitly state when it
is included in generated reports: add a short note under the heading (similar to
the existing "Per dimension 5" note on the template) clarifying that this
section is shown for the "activities" scope and when "--all" is used, and that
it should be omitted for "single-provider", "feature", and "models" scopes;
update the template text immediately above the table so maintainers know when to
keep or drop this section.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 3a2cd18b-baf3-489c-ad46-6e517792320a

📥 Commits

Reviewing files that changed from the base of the PR and between ff267a5 and 030a6cb.

📒 Files selected for processing (3)
  • .claude/skills/gap-analysis/SKILL.md
  • .claude/skills/gap-analysis/references/audit-checklist.md
  • .claude/skills/gap-analysis/references/report-template.md

| -------- | :--: | :-------: | :---: | :---: | :---: | :-: | :-----------: |
| {{provider}} | {{✅/❌/—}} | … | … | … | … | … | … |

Legend: ✅ adapter shipped · ❌ upstream offers it, no adapter (gap) · — upstream doesn't offer it (by design).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor | ⚡ Quick win

Align by-design notation with audit-checklist.md.

The legend uses "—" (em dash) for "upstream doesn't offer it (by design)", but audit-checklist.md lines 249 and 271 use "❌-by-design" notation for the same concept. These should match to avoid confusion when following the checklist to generate the report.

📝 Suggested fix
-Legend: ✅ adapter shipped · ❌ upstream offers it, no adapter (gap) · — upstream doesn't offer it (by design).
+Legend: ✅ adapter shipped · ❌ upstream offers it, no adapter (gap) · ❌-by-design upstream doesn't offer it.
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
Legend: ✅ adapter shipped · ❌ upstream offers it, no adapter (gap) · upstream doesn't offer it (by design).
Legend: ✅ adapter shipped · ❌ upstream offers it, no adapter (gap) · ❌-by-design upstream doesn't offer it.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.claude/skills/gap-analysis/references/report-template.md at line 109,
Update the legend line that currently reads "Legend: ✅ adapter shipped · ❌
upstream offers it, no adapter (gap) · — upstream doesn't offer it (by design)."
so it matches the audit checklist's notation by replacing the em dash item with
the "❌-by-design" token used in audit-checklist.md; ensure the legend contains
"❌-by-design" (or the exact token used in audit-checklist.md) instead of "—
upstream doesn't offer it (by design)" so both documents use the same notation.

@AlemTuzlak AlemTuzlak merged commit 984ac3c into main Jun 11, 2026
10 checks passed
@AlemTuzlak AlemTuzlak deleted the chore/gap-analysis-activity-coverage branch June 11, 2026 06:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants