Skip to content

Commit d32a459

Browse files
localai-botmudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#6640)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent 47b2a50 commit d32a459

File tree

1 file changed

+25
-0
lines changed

1 file changed

+25
-0
lines changed

gallery/index.yaml

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22290,3 +22290,28 @@
2229022290
- filename: John1604-AI-status-japanese-2025.Q4_K_M.gguf
2229122291
sha256: 1cf8f947d1caf9e0128ae46987358fd8f2a4c8574564ebb0de3c979d1d2f66cb
2229222292
uri: huggingface://mradermacher/John1604-AI-status-japanese-2025-GGUF/John1604-AI-status-japanese-2025.Q4_K_M.gguf
22293+
- !!merge <<: *qwen3
22294+
name: "simia-tau-sft-qwen3-8b"
22295+
urls:
22296+
- https://huggingface.co/mradermacher/Simia-Tau-SFT-Qwen3-8B-GGUF
22297+
description: |
22298+
The **Simia-Tau-SFT-Qwen3-8B** is a fine-tuned version of the Qwen3-8B language model, developed by Simia-Agent and adapted for enhanced instruction-following capabilities. This model is optimized for dialogue and task-oriented interactions, making it highly effective for real-world applications requiring nuanced understanding and coherent responses.
22299+
22300+
The model is available in multiple quantized formats (GGUF), including Q4_K_S, Q5_K_M, Q8_0, and others, enabling efficient deployment across devices with varying computational resources. These quantized versions maintain strong performance while reducing memory footprint and inference latency.
22301+
22302+
While this repository hosts a quantized variant (specifically designed for GGUF-based inference via tools like llama.cpp), the original base model is **Qwen3-8B**, a large-scale open-source language model from Alibaba Cloud. The fine-tuning (SFT) process improves its alignment with human intent and enhances its ability to follow complex instructions.
22303+
22304+
> 🔍 **Note**: This is a quantized version; for the full-precision base model, refer to [Simia-Agent/Simia-Tau-SFT-Qwen3-8B](https://huggingface.co/Simia-Agent/Simia-Tau-SFT-Qwen3-8B) on Hugging Face.
22305+
22306+
**Use Case**: Ideal for chatbots, assistant systems, and interactive applications requiring strong reasoning, safety, and fluency.
22307+
**Model Size**: 8B parameters (quantized for efficiency).
22308+
**License**: See the original model's license (typically Apache 2.0 for Qwen series).
22309+
22310+
👉 Recommended for edge deployment with GGUF-compatible tools.
22311+
overrides:
22312+
parameters:
22313+
model: Simia-Tau-SFT-Qwen3-8B.Q4_K_S.gguf
22314+
files:
22315+
- filename: Simia-Tau-SFT-Qwen3-8B.Q4_K_S.gguf
22316+
sha256: b1019b160e4a612d91edd77f00bea01f3f276ecc8ab76de526b7bf356d4c8079
22317+
uri: huggingface://mradermacher/Simia-Tau-SFT-Qwen3-8B-GGUF/Simia-Tau-SFT-Qwen3-8B.Q4_K_S.gguf

0 commit comments

Comments
 (0)