#

stable-training

Here is 1 public repository matching this topic...

bluorion-com / ZClip

Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".

loss gradient-clipping adaptive-gradient-clipping loss-spike adaptive-clipping zclip stable-llm-pretraining enable-high-learning-rate traning-stability pre-training-stability stable-training llm-stable-training gradient-norm-clipping

Updated May 12, 2025
Python

Improve this page

Add a description, image, and links to the stable-training topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the stable-training topic, visit your repo's landing page and select "manage topics."