Free LLM Training book by HuggingFace

HuggingFace pre-training team has released a book on full pipeline of building a LLM like for example pre-training, post-training, infra, etc.

200+ pages of what worked, didn’t work for them.

And this will be really useful reference if you plan on building an LLM from scratch.

Reference

• https://www.reddit.com/r/LocalLLaMA/comments/1ok3xie/200_pages_of_hugging_face_secrets_on_how_to_train/

Happy learning about-LLM!