LLM_RethinkFun

RethinkFun大模型个人学习笔记

b站up“RethinkFun”课程学习笔记

讲解通俗易懂，个人觉得是全网讲的最好的，学习到很多。推荐观看

Name		Name	Last commit message	Last commit date
Latest commit History 22 Commits
8 循环神经网络-checkpoint.ipynb		8 循环神经网络-checkpoint.ipynb
GPRO.ipynb		GPRO.ipynb
LLM结果评估.ipynb		LLM结果评估.ipynb
MCP与func call的区别-checkpoint.ipynb		MCP与func call的区别-checkpoint.ipynb
MCP与func call的区别.ipynb		MCP与func call的区别.ipynb
MoE&MLA&MTP.ipynb		MoE&MLA&MTP.ipynb
PPO&DPO.ipynb		PPO&DPO.ipynb
RAG-checkpoint.ipynb		RAG-checkpoint.ipynb
RAG.ipynb		RAG.ipynb
README.md		README.md
Sinusoidal、RoPE、ALiBi等各类位置信息编码.ipynb		Sinusoidal、RoPE、ALiBi等各类位置信息编码.ipynb
flashattention.ipynb		flashattention.ipynb
gpu原理-tensorcore.ipynb		gpu原理-tensorcore.ipynb
rope.ipynb		rope.ipynb
vllm&pageattention&kvcache.ipynb		vllm&pageattention&kvcache.ipynb
优化器的区别adam adamw sgd.ipynb		优化器的区别adam adamw sgd.ipynb
大模型分布式训练 DP，DDP，DeepSpeed ZeRO技术.ipynb		大模型分布式训练 DP，DDP，DeepSpeed ZeRO技术.ipynb
大模型显存计算&register_parameter&buffer.ipynb		大模型显存计算&register_parameter&buffer.ipynb
大模型架构GPT&llama.ipynb		大模型架构GPT&llama.ipynb
梯度检查点.ipynb		梯度检查点.ipynb
浮点型的表示&混合精度.ipynb		浮点型的表示&混合精度.ipynb

Provide feedback