Test-designer hand-back counted as dev: false 'T1 no verification: dev ran on Opus. Go straight to review.' #7

Closed
opened 2026-11-17 20:57:38 +01:00 by ems-agent · 0 comments
Collaborator

A test-designer hand-back is counted as a dev hand-back. The router then posts [model-router] T1 no verification: dev ran on Opus. Go straight to review. while no developer has run.

Seen 2026-11-17, ticket EV-05

  • Agent type test-designer. Brief header: Pipeline-Role: test-design and Clone: /home/homelab/projects/goodwe/clones/EV-05-design (Role: test-design).
  • 1st hand-back (plan FAIL, about 20:45 CET): router line "T1 no verification: dev ran on Opus. Go straight to review."
  • The same agent was resumed with SendMessage. 2nd hand-back (plan PASS): the same "T1" line again.
  • At both times the ticket was in test_design. The dev clone was at the base commit (9fdce02), and no dev report or commit existed. The real developer started later and had not handed back.

Expected

  • No router line for a test-design role (or for review/test). Per the router's own rules, only dev briefs are routed and verified.
  • Task numbers (Tn) used only for dev agents. EV-05's real developer should get T1 and a verification verdict (its brief has Expected/acceptance, so Sonnet).

Impact

  • A manager who follows the line would skip the router check and go to review with no dev commit. pipeline-guard / ticket refused nothing here only because the manager ignored the line.
  • The T-number was used up by a non-dev agent.

Guess (not checked in the code): the role is read from the Clone: line, and (Role: test-design) is not a known role, so it falls back to dev, or the hand-back hook does not filter by agent type.

🤖 Generated with Claude Code

A test-designer hand-back is counted as a dev hand-back. The router then posts `[model-router] T1 no verification: dev ran on Opus. Go straight to review.` while no developer has run. **Seen 2026-11-17, ticket EV-05** - Agent type `test-designer`. Brief header: `Pipeline-Role: test-design` and `Clone: /home/homelab/projects/goodwe/clones/EV-05-design (Role: test-design)`. - 1st hand-back (plan FAIL, about 20:45 CET): router line "T1 no verification: dev ran on Opus. Go straight to review." - The same agent was resumed with SendMessage. 2nd hand-back (plan PASS): the same "T1" line again. - At both times the ticket was in `test_design`. The dev clone was at the base commit (9fdce02), and no dev report or commit existed. The real developer started later and had not handed back. **Expected** - No router line for a `test-design` role (or for `review`/`test`). Per the router's own rules, only dev briefs are routed and verified. - Task numbers (Tn) used only for dev agents. EV-05's real developer should get T1 and a verification verdict (its brief has Expected/acceptance, so Sonnet). **Impact** - A manager who follows the line would skip the router check and go to review with no dev commit. pipeline-guard / `ticket` refused nothing here only because the manager ignored the line. - The T-number was used up by a non-dev agent. **Guess (not checked in the code):** the role is read from the `Clone:` line, and `(Role: test-design)` is not a known role, so it falls back to dev, or the hand-back hook does not filter by agent type. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
admin closed this issue 2026-11-17 21:47:53 +01:00
Sign in to join this conversation.
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: admin/model-router#7