Popular repositories Loading

1. vllm-factory vllm-factory Public

   Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

   Python 53 5

2. colsearch colsearch Public

   High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, …

   Python 11 1

3. latence-python latence-python Public

   Latence Python SDK

   Python