Search results

Inference Toolkit incompatible with transformers 5.x (is_tf_available import path changed) - due to strict transformers pin.

Status: Open.

#122 In huggingface/huggingface-inference-toolkit;

· achpalaman opened on Jan 30, 2026

Allow for configuration of MAX_CONCURRENT_THREADS

Status: Open.

#121 In huggingface/huggingface-inference-toolkit;

· marcellosch opened on Sep 3, 2025

OOM error

Status: Open.

#111 In huggingface/huggingface-inference-toolkit;

· Mcilie opened on May 7, 2025

Fix uvicorn logging when in Vertex AI

google

Status: Open.

#75 In huggingface/huggingface-inference-toolkit;

· alvarobartt opened on Jul 15, 2024

Add Support for TPUs

google

Status: Open.

#67 In huggingface/huggingface-inference-toolkit;

· rafaelpierrehf opened on Apr 15, 2024

Change payload format for embeddings to equalize with TEI format

Status: Open.

#65 In huggingface/huggingface-inference-toolkit;

· rafaelpierrehf opened on Mar 29, 2024

Serialization of audio/wav when returning

Status: Open.

#44 In huggingface/huggingface-inference-toolkit;

· philschmid opened on Aug 15, 2023

Add Optimum Support

Status: Open.

#3 In huggingface/huggingface-inference-toolkit;

· philschmid opened on Aug 1, 2022

Add Azure Frontend

onhold

Status: Open.

#1 In huggingface/huggingface-inference-toolkit;

· philschmid opened on Aug 1, 2022