Build your understanding alongside your next project. Six focused selections, from the mechanics of language models to the systems that keep them useful.
When model terminology is getting in the way of understanding application design.
Keep in mind
Use current package documentation alongside the book’s notebooks.
Model implementation
Build a Large Language Model (From Scratch)
Sebastian Raschka
Manning · Original English edition
Publisher-based selection
Who it’s for
Programmers who want to understand language models by implementing their components.
What you’ll learn
Text processing, attention, a GPT-style model, pretraining, and fine-tuning with Python and PyTorch.
Suggested prerequisites
Intermediate Python and basic machine learning; be ready to work with tensors.
When to read it
When you want to understand what happens beneath a model API.
Keep in mind
An educational implementation path; training a frontier model is a different scale of work.
EDITORIAL APPROACH
A focused shelf, with clear sources.
These selections are based on official publisher descriptions, contents, and publication details. They are not personal, cover-to-cover reviews. Reader fit, suggested prerequisites, and reading order reflect our editorial judgment.
We choose books that support concrete engineering work and connect to our field guides. The publication date describes the edition linked here, not a claim that it is the newest edition. AI Engineering uses O’Reilly’s December 2024 online publication date; its author lists the book as a 2025 title.
Cover artwork is from the linked publishers and belongs to its respective rights holders. There are no affiliate links or paid placements. Check the publisher for current editions, formats, availability, and prices. Fast-changing APIs and examples should be read alongside current documentation.