ml-infra-deployments

Here are 2 public repositories matching this topic...

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

retrieval encoder inference embeddings ner serving rag colbert ml-infra-deployments vllm gliner multimodal-rag ai-infrastructure colpali triton-kernels vllm-plugins

AWS EKS cloud-based machine learning service

kubernetes aws ml-infra-deployments

Add a description, image, and links to the ml-infra-deployments topic page so that developers can more easily learn about it.

To associate your repository with the ml-infra-deployments topic, visit your repo's landing page and select "manage topics."