Overview of self-supervised learning of tiny models, including distillation-based methods (aks. self-supervised distillation) and non-distillation methods.

Phi-3-Vision model test - running locally

Testing the Moondream tiny vision model

🔍 Explore recursive reasoning with TinyRecursiveModels, a compact 7M parameter neural network achieving high scores on tough tasks without massive resources.

🚀 Implement the Tiny Recursive Model (TRM) for improved performance in recursive tasks, building on the HRM framework by Sapient AI.