Skip to content

Issues: substratusai/kubeai

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

86 Open 110 Closed
86 Open 110 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Upgrade benchmarking script to a newer version?
#538 opened Jun 5, 2025 by PeterYang12
vllm 0.8.3 seems to have issues with some models
#533 opened May 26, 2025 by tpfau
Possible Unexpected Behavior When Setting resourceProfile to zero
#531 opened May 23, 2025 by MRColorR
Benchmarking script always raises valueError
#529 opened May 21, 2025 by joelvdvoort
FasterWhisper API VAD
#523 opened May 15, 2025 by YanickSchraner
如何直接使用模型参数启动模型呢
#521 opened May 9, 2025 by coyoteXujie
3
Example for running custom GGUF models
#517 opened Apr 29, 2025 by drtinkerer
Session Based Routing
#509 opened Apr 23, 2025 by liaddrori1
Support All VLLM routes
#508 opened Apr 23, 2025 by liaddrori1
MI300X - Not seeing any difference in Round Robin vs. PrefixHash-Aware Load Balancing
#507 opened Apr 22, 2025 by virobles
1
expose pvc size as parameter
#501 opened Apr 9, 2025 by flobrunner
Is there any plan on becoming a CNCF project?
#500 opened Apr 9, 2025 by kiwansky
7
In a multi-replica scenario, how can we ensure the consistency of the load balancer's state?
#498 opened Apr 8, 2025 by zheyang0825
Could you please provide an example of Ollama Load from PVC with a PersistentVolume whose volumeType is local?
#479 opened Mar 26, 2025 by leoho0722
5
vLLM: Disaggregated Serving support
#464 opened Mar 21, 2025 by samos123
Bug in rollout process: duplicate new Pods are created before being removed bug Something isn't working
#442 opened Mar 4, 2025 by nstogner
Update e2e tests to be applicable to any Kubernetes distro - not just kind
#438 opened Mar 3, 2025 by nstogner
Add doc that explains how rollouts are handled
#435 opened Mar 2, 2025 by samos123
Consider supporting individual deployments of the model-proxy and model-operator
#430 opened Mar 1, 2025 by nstogner
Single Model multiple resource profiles
#428 opened Feb 28, 2025 by samos123
Allow Updating Model URL for Seamless Model Replacement
#422 opened Feb 25, 2025 by liaddrori1
6
Fix CPU vLLM image
#418 opened Feb 20, 2025 by nstogner
1
2
Add support for the SGLang inference engine
#413 opened Feb 16, 2025 by nstogner
1
Document url / model engine / cache profile compatibility matrix & update validation rules
#411 opened Feb 15, 2025 by nstogner
facebook opt-125m model no longer works with chat completion
#404 opened Feb 13, 2025 by samos123
ProTip! Follow long discussions with comments:>50.