Manning Build a Large Language Model (From Scratch) | Paperback | English

Dive deep into the architecture and implementation of generative AI with Build a Large Language Model (From Scratch) by bestselling author Sebastian Raschka. This essential guide takes you inside the AI black box, providing step-by-step instructions to create, train, and customize your own GPT-style Large Language Model (LLM), capable of running on an ordinary laptop.

Based on the principle that understanding comes from building, this book walks you through every critical stage of LLM development, ensuring you gain an in-depth comprehension of how these powerful systems function, their inherent limitations, and customization techniques.

• Learn to plan and code all necessary components of an LLM from the ground up.
• Master the preparation of datasets suitable for effective LLM training.
• Understand pretraining on a general corpus and subsequent fine-tuning for specific tasks.
• Implement techniques to fine-tune LLMs using your own data and incorporate human feedback for instruction following.
• Develop the capability to load and utilize pretrained weights within your custom LLM.
• The resulting LLM can be developed on standard hardware and function as a personal assistant.

• Author: Sebastian Raschka
• Binding: Paperback
• Edition: 1st Edition
• Language: English
• Print Length: 368 pages
• Publication Date: November 1, 2024
• ISBN-10: 1633437167
• ISBN-13: 978-1633437166
• Dimensions: 187 x 18 x 235 mm
• Weight: 612 g

For computer science professionals and enthusiasts seeking practical, hands-on knowledge of modern AI systems, this book provides the foundational understanding necessary to move beyond theoretical concepts and build functional LLMs.