Add Redpanda Kafka-compatible hosting integration by slang25 · Pull Request #1410 · CommunityToolkit/Aspire

slang25 · 2026-06-14T08:59:33Z

Closes #<ISSUE_NUMBER>

Adds CommunityToolkit.Aspire.Hosting.RedPanda, an Aspire hosting integration for the Redpanda Kafka-compatible streaming platform. AddRedPanda runs a single-node broker (pinned image redpandadata/redpanda:v26.1.10) exposing Kafka, internal, Schema Registry, and Admin endpoints with an Admin-API health check, and the resource can be referenced by any Kafka client integration. Optional extensions cover WithConsole (Redpanda Console web UI, redpandadata/console:v3.7.4), WithDataVolume/WithDataBindMount for persistence, and WithHostPort. The change also adds unit and Docker-based integration tests, an example AppHost, a package README, and wires the projects into the solution, README catalog, and a repo-wide MessagePack NuGet audit suppression.

PR Checklist

Other information

The Kafka listener setup mirrors the upstream Aspire.Hosting.Kafka pattern: the connection string targets the host-facing kafka endpoint, while a separate internal listener (advertised as {resource}:29092) is used for container-to-container traffic, including the bundled console.

🤖 Generated with Claude Code

github-actions · 2026-06-14T08:59:41Z

🚀 Dogfood this PR with:

⚠️ WARNING: Do not do this without first carefully reviewing the code of this PR to satisfy yourself it is safe.

curl -fsSL https://raw.githubusercontent.com/CommunityToolkit/Aspire/main/eng/scripts/dogfood-pr.sh | bash -s -- 1410

Or

Run remotely in PowerShell:

iex "& { $(irm https://raw.githubusercontent.com/CommunityToolkit/Aspire/main/eng/scripts/dogfood-pr.ps1) } 1410"

Copilot

Pull request overview

Note

Copilot was unable to run its full agentic suite in this review.

Adds a new Aspire hosting integration for Redpanda (Kafka-compatible streaming platform), including the core hosting resource/builder APIs, docs, examples, and tests.

Changes:

Introduces AddRedPanda(...) and related builder extensions (console + data persistence) plus exported resource types.
Adds a Redpanda example AppHost project.
Adds unit + integration tests and links the new integration from the repo README (plus a NuGet audit suppression note).

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
tests/CommunityToolkit.Aspire.Hosting.RedPanda.Tests/ResourceCreationTests.cs	Adds unit tests validating resource creation, endpoints, image annotations, console, and volume mounts.
tests/CommunityToolkit.Aspire.Hosting.RedPanda.Tests/AppHostTests.cs	Adds Docker-based integration tests validating Redpanda Admin API and Schema Registry readiness.
tests/CommunityToolkit.Aspire.Hosting.RedPanda.Tests/CommunityToolkit.Aspire.Hosting.RedPanda.Tests.csproj	Introduces a new test project referencing the new hosting package + example AppHost.
src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaServerResource.cs	Adds the primary Redpanda server resource with connection-string expression and exported properties.
src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaConsoleContainerResource.cs	Adds the Redpanda Console container resource type.
src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaContainerImageTags.cs	Centralizes pinned image/registry/tag constants for broker and console images.
src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaBuilderExtensions.cs	Implements `AddRedPanda`, persistence options, console support, and container configuration (args/env/healthcheck).
src/CommunityToolkit.Aspire.Hosting.RedPanda/README.md	Documents usage, endpoints, and pinned upstream images/tags.
src/CommunityToolkit.Aspire.Hosting.RedPanda/CommunityToolkit.Aspire.Hosting.RedPanda.csproj	Adds the new hosting package project and exposes internals to the test assembly.
examples/redpanda/CommunityToolkit.Aspire.Hosting.RedPanda.AppHost/Program.cs	Adds an example AppHost that provisions Redpanda + Console.
examples/redpanda/CommunityToolkit.Aspire.Hosting.RedPanda.AppHost/appsettings.json	Adds logging defaults for the example AppHost.
examples/redpanda/CommunityToolkit.Aspire.Hosting.RedPanda.AppHost/Properties/launchSettings.json	Adds launch profiles for the example AppHost.
examples/redpanda/CommunityToolkit.Aspire.Hosting.RedPanda.AppHost/CommunityToolkit.Aspire.Hosting.RedPanda.AppHost.csproj	Adds the example AppHost project file referencing the new hosting package.
README.md	Adds Redpanda integration entry + NuGet/doc links to the main repository readme table.
Directory.Build.props	Adds a repo-wide NuGet audit suppression entry with justification comment.
CommunityToolkit.Aspire.slnx	Adds the new Redpanda src/tests projects and the example folder/project to the solution.

Odonno

LGTM.

Just one question: can Kafbat UI also be supported? (see Kafka integration)

slang25 · 2026-06-19T14:53:50Z

@aaronpowell 👋 are you able to take a look when you have some time 🙂

Adds CommunityToolkit.Aspire.Hosting.RedPanda, an Aspire hosting package for the Redpanda Kafka-compatible streaming platform. Includes AddRedPanda with Kafka, internal, Schema Registry, and Admin endpoints, WithConsole, WithDataVolume/WithDataBindMount, and WithHostPort extensions, plus unit and Docker integration tests, an example AppHost, README, and solution and NuGet audit wiring. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

Addresses PR review feedback: introduces RedPandaServerOptions with CpuCount and Memory, plus an AddRedPanda overload taking a configuration delegate so the Redpanda --smp and --memory limits are no longer hard coded. Adds a unit test for WithDataBindMount and tests covering the default and configured broker arguments. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

Adds an optional WithKafkaUI extension that runs the kafbat/kafka-ui container (the same UI used by the official Aspire Kafka integration) wired to the Redpanda broker's Kafka API and Schema Registry, alongside the existing Redpanda Console. Includes a dedicated resource type, a WithHostPort overload, README example, and unit tests. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

Main bumped AspireVersion to 13.4.3; update the Redpanda example AppHost to use Aspire.AppHost.Sdk/13.4.3 to match the rest of the repo and avoid an Aspire.Hosting.AppHost package downgrade in the test project. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

aaronpowell

Couple of changes requested inline. Can you also create a TypeScript app host and an associated test to run it.

My only apprehension is that the sample app is very simplistic and I worry it doesn't give a real indication of how you could use this integration. Would it result in much additional code/complexity to have an app that consumes the Redpanda resource?

Odonno · 2026-06-29T09:52:48Z

@aaronpowell I will dogfood this once it is released for info.

- Reference MessagePack explicitly to resolve the CVE instead of suppressing the advisory repo-wide (per maintainer guidance). - Remove the ASPIREATS001 experimental pragmas; the AspireExport API is no longer experimental on the current Aspire version. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

- Add a TypeScript app host example plus a TypeScriptAppHostTests test that validates it compiles and starts (mirrors the other integrations). - Make the sample app demonstrate real usage: a consumer web app that produces to and consumes from the broker via Aspire.Confluent.Kafka, wired to the resource with WithReference. Adds an example ServiceDefaults project and registers Aspire.Confluent.Kafka in CPM. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

aaronpowell · 2026-06-30T04:32:50Z

@Odonno - you should be able to install the dogfood build per #1410 (comment) before it's merged.

Copilot AI review requested due to automatic review settings June 14, 2026 08:59

Copilot AI reviewed Jun 14, 2026

View reviewed changes

Comment thread src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaBuilderExtensions.cs

Comment thread src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaBuilderExtensions.cs

Comment thread src/CommunityToolkit.Aspire.Hosting.RedPanda/RedPandaBuilderExtensions.cs Outdated

Odonno approved these changes Jun 14, 2026

View reviewed changes

slang25 and others added 4 commits June 23, 2026 23:16

slang25 force-pushed the slang25/redpanda-hosting-package branch from f8bac6e to 14e039d Compare June 23, 2026 22:19

slang25 and others added 2 commits June 26, 2026 00:58

Merge branch 'main' into slang25/redpanda-hosting-package

03a93c0

Merge branch 'main' into slang25/redpanda-hosting-package

73f6caf

aaronpowell requested changes Jun 29, 2026

View reviewed changes

slang25 and others added 3 commits June 29, 2026 11:12

Merge branch 'main' into slang25/redpanda-hosting-package

980694d

slang25 requested a review from aaronpowell June 29, 2026 13:40

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add Redpanda Kafka-compatible hosting integration#1410

Add Redpanda Kafka-compatible hosting integration#1410
slang25 wants to merge 9 commits into
CommunityToolkit:mainfrom
slang25:slang25/redpanda-hosting-package

slang25 commented Jun 14, 2026

Uh oh!

github-actions Bot commented Jun 14, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Odonno left a comment

Uh oh!

slang25 commented Jun 19, 2026

Uh oh!

aaronpowell left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Odonno commented Jun 29, 2026

Uh oh!

aaronpowell commented Jun 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

slang25 commented Jun 14, 2026

PR Checklist

Other information

Uh oh!

github-actions Bot commented Jun 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Odonno left a comment

Choose a reason for hiding this comment

Uh oh!

slang25 commented Jun 19, 2026

Uh oh!

aaronpowell left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Odonno commented Jun 29, 2026

Uh oh!

aaronpowell commented Jun 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

github-actions Bot commented Jun 14, 2026 •

edited

Loading