Skip to content

Conversation

@MohammedTaherMcW
Copy link

Ticket

Link to Github Issue

Problem description

Added Performance and Accuracy Test for Gemma-3-1b-it

What's changed

Added performance metrics support in simple_text_demo
Added Accuracy metrics support in test_accuracy
Added refpt file for gemma-3-1b-it
Added baseline perf metrics of top-1% and top-5% for gemma-3-1b-it
Added CI Test Support

Checklist

@jennychristopher jennychristopher force-pushed the mcw/gemma_3_1b/pr_3_vLLM branch from 1952cd6 to e324df8 Compare August 5, 2025 15:22
@MohammedTaherMcW
Copy link
Author

@willwray @jschuhmacher @ashish-flexai, We need to add Owner ID for Gemma-3-1b-it in single-card-demo-tests-impl.yaml,
Currently we are not sure of what should be the owner ID, So we just added the line and commented it out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants