Skip to content

feat(iorails): Support non-streaming GenerationResponse#2178

Draft
tgasser-nv wants to merge 6 commits into
developfrom
feat/iorails-structured-response
Draft

feat(iorails): Support non-streaming GenerationResponse#2178
tgasser-nv wants to merge 6 commits into
developfrom
feat/iorails-structured-response

Conversation

@tgasser-nv

Copy link
Copy Markdown
Collaborator
  • Initial checkin of GenerationResponse code (non-streaming only, no token usage)
  • Promote options to a named argument rather than smuggled in through kwargs

Description

Related Issue(s)

Verification

AI Assistance

  • No AI tools were used.
  • AI tools were used; a human reviewed and can explain every change (tool: ___).

Checklist

  • I've read the CONTRIBUTING guidelines.
  • This PR links to a triaged issue assigned to me.
  • My PR title follows the project commit convention.
  • I've updated the documentation if applicable.
  • I've added tests if applicable.
  • I've noted any verification beyond CI and any checks I couldn't run.
  • I did not update generated changelog files manually.
  • I addressed all CodeRabbit, Greptile, and other review comments, or replied with why no change is needed.
  • @mentions of the person or team responsible for reviewing proposed changes.

@github-actions github-actions Bot added size: L status: needs triage New issues that have not yet been reviewed or categorized. labels Jul 16, 2026
@codecov

codecov Bot commented Jul 16, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 97.10145% with 6 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
nemoguardrails/guardrails/iorails.py 94.73% 6 Missing ⚠️

📢 Thoughts on this report? Let us know!

@tgasser-nv tgasser-nv changed the title feat(iorails): Return GenerationResponse for non-streaming inference (without token usage) feat(iorails): Support non-streaming GenerationResponse Jul 16, 2026
@tgasser-nv tgasser-nv added status: triaged Triaged by a maintainer; eligible for automated review (CodeRabbit/Greptile). and removed status: needs triage New issues that have not yet been reviewed or categorized. labels Jul 17, 2026
@github-actions github-actions Bot added size: XL and removed size: L labels Jul 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size: XL status: triaged Triaged by a maintainer; eligible for automated review (CodeRabbit/Greptile).

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant