test execution support in vscode

[pelikhan]

• needs to be reimplemented without promptfoo

[github-actions]

Thanks for raising this issue. The request to reimplement test execution support in VS Code without using promptfoo is clear. However, it would be helpful to clarify a few points to ensure the work is aligned with your expectations:

• Are there specific limitations or problems with promptfoo that should be addressed in the new implementation?
• Should the scope include feature parity with the existing promptfoo-based tests, or are there new requirements or changes to test execution?
• Are there particular use cases or platforms within VS Code that should be prioritized?

Providing more details on the motivation and desired outcomes will help ensure the new implementation meets your needs.

AI-generated content by issue-reviewer may be incorrect. Use reactions to eval.

[pelikhan]

Implement the keywords, assertions documented in the PromptPex interface in the test runner in the cli.