Skip to content

Conversation

@nikileshx
Copy link

Ticket

Link to JIRA

Problem description

Added Performance and Accuracy Test for Mistral-Small-3.1-24B-Instruct-2503

What's changed

  • Added performance metrics support in simple_text_demo
  • Added performance metrics support in simple_vision_demo
  • Added Accuracy metrics support in test_accuracy
  • Added refpt file for Qwen 2.5 VL 7B
  • Added baseline perf metrics of top-1% and top-5% for Mistral-Small-3.1-24B-Instruct-2503
  • Added CI Test Support

Checklist

@nikileshx nikileshx marked this pull request as ready for review August 22, 2025 11:45
@nikileshx nikileshx force-pushed the mcw/mistral-small-3.1-24b-it/pr_3_vllm branch 3 times, most recently from 3a41732 to 772ee5f Compare August 22, 2025 16:30
@nikileshx nikileshx force-pushed the mcw/mistral-small-3.1-24b-it/pr_4_performance branch from cdc8656 to 0441e87 Compare August 22, 2025 16:38
@nikileshx nikileshx requested a review from willwray August 22, 2025 17:37
@nikileshx nikileshx force-pushed the mcw/mistral-small-3.1-24b-it/pr_3_vllm branch from 772ee5f to 365b2d7 Compare August 29, 2025 07:56
@nikileshx nikileshx force-pushed the mcw/mistral-small-3.1-24b-it/pr_4_performance branch from 0441e87 to ea7a53f Compare August 29, 2025 09:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants