feat(agents): add enablement dimension to Experiment Designer for code-with MVEs#1416
feat(agents): add enablement dimension to Experiment Designer for code-with MVEs#1416eedorenko wants to merge 12 commits intomicrosoft:mainfrom
Conversation
…-with MVEs Adds dual-purpose (validate + enable) guidance for MVEs conducted as code-with engagements. In these contexts, the customer must leave the MVE owning the full technology stack, not just seeing a working demo. Agent changes: - Phase 1: added probing questions for code-with context and customer knowledge level - Phase 3: added 'Show without teach' red flag - Phase 4: added Enablement Design section with pairing structure, ownership progression, and knowledge transfer checkpoints - Phase 5: added enablement plan to mve-plan.md contents - Coaching Style: reinforced dual purpose and flagged passive customer as a failure mode Instructions changes: - Added 'MVE as Enablement' section defining the dual-purpose model - Added 'Show without teach' to Red Flags - Added 'Customer as passive observer' to Common Pitfalls
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1416 +/- ##
==========================================
- Coverage 87.44% 87.16% -0.28%
==========================================
Files 68 67 -1
Lines 10335 10067 -268
==========================================
- Hits 9037 8775 -262
+ Misses 1298 1292 -6
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
bindsi
left a comment
There was a problem hiding this comment.
Good additions to the agent/instructions to give more accuracy and constraints. Thanks
Replace ISE-specific references with 'forward deployed engineering (FDE)' and generic 'engineering team' / 'guiding team' language so the agent is applicable to any engineering team using the extension. Addresses review feedback from @mattdot.
katriendg
left a comment
There was a problem hiding this comment.
Thanks, great additions. Only comments left are around generalizing more. Taking into account this could be used by any type of teams collaborating together.
Replace 'code-with', 'FDE', and 'customer' with generic terms: - 'code-with engagement' → 'collaborative engagement' - 'customer' → 'partner team' (in enablement sections) - 'guiding team' → 'advisory team' - Section headers updated accordingly Makes the enablement concepts applicable to any engineering team, not predicated on a specific engagement model. Addresses review feedback from @mattdot and @katriendg.
Fix typo "halluccinates" → "hallucinates" and add "wireframes" to cspell dictionary. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
katriendg
left a comment
There was a problem hiding this comment.
Thank you @eedorenko, this looks good to me other than the committed json files which I believe should be removed, they don't fit this PR.
Once that is done, all good for me.
|
@mattdot could you please re-review this one? Thanks. |
Remove beval/results/*.json artifacts that were accidentally committed. Revert the cspell workaround that was only needed for those files. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
In code-with engagements (ISE or similar), MVEs serve a dual purpose: validate feasibility and enable the customer to own the outcome independently. The Experiment Designer agent previously focused entirely on the validation side — hypothesis formation, vetting, and experiment design — without prompting the user to think about whether the customer would leave the engagement able to replicate the work.
This PR adds enablement-aware guidance throughout the agent's phases and companion instructions, drawn from a real ISE engagement designing an MVE for Azure Confidential Computing migration.
Changes
Agent: Experiment Designer (
experiment-designer.agent.md)context.md.mve-plan.mdcontents list.Instructions: Experiment Designer (
experiment-designer.instructions.md)Notes