Copyright © 2024 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a
retrieval system, or transmitted in any form or by any means, without the
prior written permission of the publisher, except in the case of brief
quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the
accuracy of the information presented. However, the information contained
in this book is sold without warranty, either express or implied. Neither the
author, nor Packt Publishing, and its dealers and distributors will be held
liable for any damages caused or alleged to be caused directly or indirectly
by this book.
Packt Publishing has endeavored to provide trademark information about all
of the companies and products mentioned in this book by the appropriate
use of capitals. However, Packt Publishing cannot guarantee the accuracy of
this information.
Early Access Publication: LLMs in Enterprise
Early Access Production Reference: B31372
Published by Packt Publishing Ltd.
,Grosvenor House
11 St Paul's Square
Birmingham
B3 1RB, UK
ISBN: 978-1-83620-307-0
www.packt.com
OceanofPDF.com
, Table of Contents
LLMs in Enterprise: Design strategies for large language model
development, design patterns and best practices
1. 1 Introduction to Large Language Models (LLMs)
1. Historical Context and Evolution of Language Models (LMs)
1. Early Developments
2. Evolution Over Time
3. Computational Advances and Increasing Data Availability
4. LLMs and Transforming User Interfaces into Natural
Conversations
2. Evolutions of LLMs Architectures
1. Early Foundations: Word Embeddings
2. Breakthrough with Transformers
3. The Rise of Pre-trained Models
4. Multimodality and Beyond
5. Mixture of Experts (MoE): Revolutionizing Language Model
Architectures
3. GPT Assistant Training Recipe
1. Building the Base Model
2. Supervised Fine-Tuning(SFT) Stage
3. Reward Modelling Stage
4. Reinforcement Learning Stage
4. Decoding the Realities and Myths of LLMs