Exercise the installed Postmark skill in live agent email E2E#1337
Open
bingran-you wants to merge 2 commits intodevfrom
Open
Exercise the installed Postmark skill in live agent email E2E#1337bingran-you wants to merge 2 commits intodevfrom
bingran-you wants to merge 2 commits intodevfrom
Conversation
The earlier draft test shape described a Postmark skill flow but built a temp workspace without the repo skill and relied on direct API instructions. This change copies the real postmark-send-email skill into the workspace, explicitly invokes , enables networked agent execution, and verifies both basic delivery and attachment delivery through Postmark. Constraint: Live execution requires Postmark credentials plus Codex/Azure backup model env Rejected: Keep a direct API-only workspace | does not validate installed skill availability or invocation Confidence: medium Scope-risk: narrow Reversibility: clean Directive: Keep this test anchored to the real .agents/skills/postmark-send-email path instead of replacing it with raw API-only instructions Tested: POSTMARK_LIVE_TEST=0 RUN_CODEX_E2E=0 cargo test -p scheduler_module --test agent_postmark_skill_e2e -- --nocapture Not-tested: Live Postmark/Codex run with real credentials Related: #706
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Contributor
Author
|
PR description added. This draft PR looks ready for review once tests pass. Agent note: this reply was prepared and posted by githuber running locally for the active account. |
Co-authored-by: bingran-you <bingran-you@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds live end-to-end tests that exercise the installed
postmark-send-emailskill via the Codex agent.Changes
New test file (
agent_postmark_skill_e2e.rs): Two test scenarios covering agent-driven Postmark email delivery:agent_sends_email_via_postmark_skill- Simple email sendagent_sends_email_with_attachment_via_postmark_skill- Email with attachmentTest plan update: Added
LIVE-MAIL-02entry toDoWhiz_service_tests.mdTest Requirements
POSTMARK_LIVE_TEST=1 RUN_CODEX_E2E=1 cargo test -p scheduler_module --test agent_postmark_skill_e2e -- --nocaptureRequired env vars:
POSTMARK_SERVER_TOKEN,AZURE_OPENAI_API_KEY_BACKUP,AZURE_OPENAI_ENDPOINT_BACKUPWhat these tests verify
.agents/skills/postmark-send-email/SKILL.mdpostmark_result.jsonwith status and message ID