[PHASE 3] End-to-end testing on real PRs

[ashleyshaw]

Phase 3d: End-to-End Testing (Week 3)

Test complete v2.0 workflow on real PRs to ensure all integrations work together correctly.

🎯 Objectives

• Test on 5+ real PRs (mix of bug fixes, features, refactors)
• Verify all 12 steps execute correctly
• Verify all agents/skills work together
• Document any issues or gaps
• Approve workflow for deployment

📋 Test Scenarios

Test 1: Feature PR with Changelog

• Changelog entry validated (STEP 2)
• Labels applied correctly (STEP 5)
• Issue type allocated (STEP 6)
• Issue updated with PR link (STEP 7)
• PR merged successfully (STEP 10)
• Issue closed on merge (STEP 12)

Test 2: Bug Fix with Missing Labels

• Changelog entry validated (STEP 2)
• Label audit recommends missing families (STEP 5)
• Recommendations applied correctly
• PR merged (STEP 10)

Test 3: Pre-existing CI Failure

• CI failure detected (STEP 1)
• Failure confirmed as pre-existing (STEP 11)
• Issue created for pre-existing failure (STEP 11)
• PR merges despite CI failure (STEP 10)

Test 4: Refactor with Remaining Work

• Changelog entry validated (STEP 2)
• Issue marked with remaining work (STEP 12)
• Issue kept open (not closed)
• Comment added with remaining work list

Test 5: Documentation Update (No Changelog)

• Changelog validation skipped (STEP 2)
• Labels applied correctly (STEP 5)
• PR merged successfully (STEP 10)

✅ Acceptance Criteria

• All 5 test scenarios pass
• No blockers encountered
• All agents/skills execute correctly
• Workflow completes in < 5 min per PR
• No manual intervention needed
• Team approves workflow for deployment

📝 Testing Checklist

For each test PR:

• STEP 1: PR details fetched
• STEP 2: Changelog validated
• STEP 3: Review recommendations applied
• STEP 4: PR template updated
• STEP 5: Labels applied (with audit)
• STEP 6: Issue type allocated
• STEP 7: Issue updated
• STEP 8: Rebase if necessary
• STEP 9: Final checks passed
• STEP 10: Merged successfully
• STEP 11: CI errors documented (if any)
• STEP 12: Post-merge cleanup done

🔗 Related Issues

Epic: #2681
Phase 3a: #2685 (Changelog integration)
Phase 3b: #2686 (Label Audit integration)
Phase 3c: #2687 (Issue Agent integration)
Next Phase: #2689–#2691 (Phase 4: Future enhancements)

📊 Effort & Timeline

Timeline: 2026-09-18 to 2026-09-19
Effort: 4–6 hours (run 5 test scenarios + document results)
Owner: Ashley Shaw + Team Review

📚 Deliverables

• Test execution logs
• Issue documentation
• Approval signoff
• v2.0 workflow ready for deployment

[linear-code]

LS-3127

[github-actions]

⚠️ This issue does not follow a required issue template.

Missing required section(s): Definition of Ready (DoR), Definition of Done (DoD)

The issue will remain open and flagged until the body is corrected.
Please update the issue with one of the official templates:

• https://github.com/lightspeedwp/.github/issues/new/choose

If this was opened by automation, update the automation to preserve the template sections before creating the issue.