Concyclics / vllm_bench Public

Notifications You must be signed in to change notification settings
Fork 1
Star 5

Benchmark vllm with different parallel settings

5 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
figures		figures
result		result
README.md		README.md
run.sh		run.sh

Repository files navigation

vllm Bench with different parallel settings

How to Run

edit model and settings in run.sh

pip install vllm
./run.sh

About

Benchmark vllm with different parallel settings

Report repository

Releases

No releases published

Packages

No packages published

Languages

Shell 100.0%