-
Notifications
You must be signed in to change notification settings - Fork 46
Description
Description
Smoke test workflows create issues without labels, requiring the auto-triage agent to label them after creation. Adding automatic labeling directly to smoke test workflows would eliminate this extra step.
Current Behavior
From Auto-Triage Reports (2026-02-02, 2026-02-03):
Pattern observed:
- Smoke test issues created without labels
- Auto-triage agent processes them later
- Consistently applies:
testing+automationlabels - 100% of smoke test issues receive these labels
Examples:
- Issue Smoke Test: Copilot - 21612700847 #13369: "Smoke Test: Copilot" - labeled by auto-triage
- Issue Smoke Test: Copilot - 21597875170 #13316: "Smoke Test: Copilot" - labeled by auto-triage
- Issue Smoke Test: Project Operations - 21597875220 #13314: "Smoke Test: Project Operations" - labeled by auto-triage
Suggested Changes
Update Smoke Test Workflows
Modify smoke test workflows to add labels at issue creation:
# Example: .github/workflows/smoke-copilot.md
safe-outputs:
create_issue:
title: "Smoke Test: Copilot - {{run_id}}"
body: |
### Test Summary
...
labels:
- testing # Add this
- automation # Add this
- smoke-test # Consider adding specific labelFiles to Update
Likely candidates (search for smoke test workflows):
.github/workflows/smoke-copilot*.md.github/workflows/smoke-claude*.md.github/workflows/smoke-project*.md- Any other smoke test workflow files
Benefits
- Immediate labeling: Issues have correct labels from creation
- Reduces auto-triage load: Fewer unlabeled issues to process
- Consistency: Labels applied at source, not retroactively
- Pattern consistency: Matches recommendation from auto-triage reports
Files Affected
All smoke test workflow files in .github/workflows/:
# Find smoke test workflows
grep -l "Smoke Test" .github/workflows/*.mdSuccess Criteria
- All smoke test workflows include
labels:increate_issuesafe output - At minimum:
testingandautomationlabels - Consider adding:
smoke-testlabel for easy filtering - Auto-triage reports show 0 smoke test issues to process
- MUST run
make recompileafter workflow changes - MUST run
make agent-finishbefore committing
Implementation Notes
- Check if
safe-outputssupportslabels:parameter increate_issue - If not, this may require updating safe-outputs implementation first
- Test with one smoke test workflow before applying to all
Impact
- Reduces auto-triage processing time
- Improves issue organization from creation
- Eliminates delay between issue creation and labeling
- Follows automation best practices
Source
Extracted from Auto-Triage Report discussions #13331 and #13374 (2026-02-02, 2026-02-03).
Recommendation: "Consider adding automatic labeling to the smoke test workflow itself".
Priority
Low - Process improvement, not blocking functionality (auto-triage handles it currently)
AI generated by Discussion Task Miner - Code Quality Improvement Agent
- expires on Feb 17, 2026, 5:23 AM UTC