Add Secret AI as a local app #1690
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hey there! 👋
This PR adds Secret AI as a local app option for running models on Hugging Face. We're excited to contribute to this amazing
project! 🚀
About Secret AI
Secret AI is a cross-platform application that brings the power of Large Language Models to your devices locally. Whether you're on
macOS, iOS, or Android, Secret AI makes it easy to run AI models without relying on cloud services.
Key Features
Performance Highlights
Secret AI leverages mobile GPU capabilities to deliver exceptional performance:
Implementation Details
Added
isMnnModel()
helper function to intelligently detect MNN models:taobao-mnn
organization-MNN
suffix (following naming conventions)mnn
tag supportDeeplink integration:
secret-ai://pages/huggingface/repos/{model_id}?format={format}
Display logic: Shows for text-generation models supporting GGUF, MLX, or MNN formats
✅ Testing
We've thoroughly tested the implementation:
unsloth/Qwen3-1.7B-GGUF
)taobao-mnn/deepseek-llm-7b-chat-MNN
)🙏 Thank You!
Thanks for considering this PR! We're looking forward to making Hugging Face models more accessible to users across different
platforms, with the added benefit of GPU acceleration for enhanced performance. If you have any questions or need any adjustments,
please don't hesitate to let us know. We're happy to help! 😊