Demystifying Large Language Models: Unraveling the Mysteries of Language Transformer Models, Build from Ground up, Pre-train, Fine-tune and Deployment (Paperback or Softback)
Language: English
Published by James Chen 4/25/2024, 2024
- Softcover
- New
Seller: BargainBookStores, Grand Rapids, MI, U.S.A.BargainBookStores
AbeBooks seller since January 23, 2002
Condition: New
£ 23.88
Quantity: 5 available
Add to basketItem description from seller
Demystifying Large Language Models: Unraveling the Mysteries of Language Transformer Models, Build from Ground up, Pre-train, Fine-tune and Deployment.
Seller Inventory # BBS-9781738908486
- Title
- Demystifying Large Language Models: Unraveling the Mysteries of Language Transformer Models, Build from Ground up, Pre-train, Fine-tune and Deployment (Paperback or Softback)
- Author
- Chen, James
- Publisher
- James Chen 4/25/2024
- Publication year
- 2024
- Condition
- New
- Book Type
- Book
- Binding
- Paperback or Softback
- Language
- English
- ISBN 10
- 1738908488
- ISBN 13
- 9781738908486
- Item weight
- 1.02 pounds
This book is a comprehensive guide aiming to demystify the world of transformers -- the architecture that powers Large Language Models (LLMs) like GPT and BERT. From PyTorch basics and mathematical foundations to implementing a Transformer from scratch, you'll gain a deep understanding of the inner workings of these models.
That's just the beginning. Get ready to dive into the realm of pre-training your own Transformer from scratch, unlocking the power of transfer learning to fine-tune LLMs for your specific use cases, explore advanced techniques like PEFT (Prompting for Efficient Fine-Tuning) and LoRA (Low-Rank Adaptation) for fine-tuning.
Step into the deployment of LLMs, delivering these state-of-the-art language models into the real-world, whether integrating them into cloud platforms or optimizing them for edge devices, this section ensures you're equipped with the know-how to bring your AI solutions to life.
Whether you're a seasoned AI practitioner, a data scientist, or a curious developer eager to advance your knowledge on the powerful LLMs, this book is your ultimate guide to mastering these cutting-edge models. By translating convoluted concepts into understandable explanations and offering a practical hands-on approach, this treasure trove of knowledge is invaluable to both aspiring beginners and seasoned professionals.
Table of Contents
1. INTRODUCTION1.1 What is AI, ML, DL, Generative AI and Large Language Model
1.2 Lifecycle of Large Language Models
1.3 Whom This Book Is For
1.4 How This Book Is Organized
1.5 Source Code and Resources
2. PYTORCH BASICS AND MATH FUNDAMENTALS
2.1 Tensor and Vector
2.2 Tensor and Matrix
2.3 Dot Product
2.4 Softmax
2.5 Cross Entropy
2.6 GPU Support
2.7 Linear Transformation
2.8 Embedding
2.9 Neural Network
2.10 Bigram and N-gram Models
2.11 Greedy, Random Sampling and Beam
2.12 Rank of Matrices
2.13 Singular Value Decomposition (SVD)
2.14 Conclusion
3. TRANSFORMER
3.1 Dataset and Tokenization
3.2 Embedding
3.3 Positional Encoding
3.4 Layer Normalization
3.5 Feed Forward
3.6 Scaled Dot-Product Attention
3.7 Mask
3.8 Multi-Head Attention
3.9 Encoder Layer and Encoder
3.10 Decoder Layer and Decoder
3.11 Transformer
3.12 Training
3.13 Inference
3.14 Conclusion
4. PRE-TRAINING
4.1 Machine Translation
4.2 Dataset and Tokenization
4.3 Load Data in Batch
4.4 Pre-Training nn.Transformer Model
4.5 Inference
4.6 Popular Large Language Models
4.7 Computational Resources
4.8 Prompt Engineering and In-context Learning (ICL)
4.9 Prompt Engineering on FLAN-T5
4.10 Pipelines
4.11 Conclusion
5. FINE-TUNING
5.1 Fine-Tuning
5.2 Parameter Efficient Fine-tuning (PEFT)
5.3 Low-Rank Adaptation (LoRA)
5.4 Adapter
5.5 Prompt Tuning
5.6 Evaluation
5.7 Reinforcement Learning
5.8 Reinforcement Learning Human Feedback (RLHF)
5.9 Implementation of RLHF
5.10 Conclusion
6. DEPLOYMENT OF LLMS
6.1 Challenges and Considerations
6.2 Pre-Deployment Optimization
6.3 Security and Privacy
6.4 Deployment Architectures
6.5 Scalability and Load Balancing
6.6 Compliance and Ethics Review
6.7 Model Versioning and Updates
6.8 LLM-Powered Applications
6.9 Vector Database
6.10 LangChain
6.11 Chatbot, Example of LLM-Powered Application
6.12 WebUI, Example of LLM-Power Application
6.13 Future Trends and Challenges
6.14 Conclusion
INDEX
REFERENCES
ABOUT THE AUTHOR
"Synopsis" may belong to another edition of this title.
BargainBookStores
Grand Rapids, MI, U.S.A.
AbeBooks seller since January 23, 2002
Shipping rates within U.S.A.
| Item | 4 to 10 business days | 4 to 9 business days |
|---|---|---|
| First item | £ 0.00 | £ 29.64 |
Payment methods
Store description
Save up to 90% on your favorite items at BargainBookStores.com! Our 20,000 square foot warehouse in Grand Rapids, Michigan is filled with hundreds of thousands of books and consumer goods, all at the lowest prices! We've been serving internet customers with great deals since 2001. All books ship from Grand Rapids, Michigan. 100% Customer Satisfaction Guaranteed We want to ensure your satisfaction. If you are dissatisfied with your purchase or shopping experience, we would like to hear from you. Please contact us by email: cs@bargainbookstores.com. Please be sure to include your contact information and order number. We do not charge a restocking fee for returns. Your Privacy BargainBookStores.com does not provide, sell or market customer information to other businesses or organizations.…
Specialty
Out of Print Books, Specializing in Academic and Professional Books, Bargain Books - Save Up to 90% Off Publisher's List Price!, Remainder Books, Store-Wide Range of New Books in all CategoriesSeller's business information
BargainBookStores
3423 Lousma Dr SE
Grand Rapids, MI U.S.A. 49548
Terms of sale
BargainBookStores guarantees 100% Customer Satisfaction. We ship worldwide and offer a variety of shipping methods to meet your needs. Please place your order directly via ABEBooks.com. We accept payment by MasterCard and Visa. For more information, contact us by email at cs@bargainbookstores.com. Full contact info is below:
BargainBookStores.com LLC
3423 Lousma Dr SE
Grand Rapids, MI 49548
Right of withdrawal
If you are a consumer you can withdraw from the contract in accordance with the following. Consumer means any natural person who is acting for purposes which are outside his trade, business, craft or profession.
Information regarding the right of withdrawal
Statutory right to withdraw
You have the right to withdraw from this contract within 14 days without giving any reason.
The withdrawal period will expire after 14 days from the day on which you acquire, or a third party other than the carrier and indicated by you acquires, physical possession of the last good or the last lot or piece.
To exercise the right of withdrawal, electronically fill in and submit a clear statement on our website, under "My Purchases" in "My Account". We will communicate to you an acknowledgement of receipt of such a withdrawal on a durable medium (e.g. by e-mail) without delay.
To meet the withdrawal deadline, it is sufficient for you to send your communication concerning your exercise of the right of withdrawal before the withdrawal period has expired.
Effects of withdrawal
If you withdraw from this contract, we will reimburse to you all payments received from you, including the costs of delivery (except for the supplementary costs arising if you chose a type of delivery other than the least expensive type of standard delivery offered by us).
We may make a deduction from the reimbursement for loss in value of any goods supplied, if the loss is the result of unnecessary handling by you.
We will make the reimbursement without undue delay, and not later than 14 days after the day on which we are informed about your decision to withdraw from this contract.
We will make the reimbursement using the same means of payment as you used for the initial transaction, unless you have expressly agreed otherwise; in any event, you will not incur any fees as a result of such reimbursement.
We may withhold reimbursement until we have received the goods back, or you have supplied evidence of having sent back the goods, whichever is the earliest.
You shall send back the goods or hand them over to BargainBookStores, Grand Rapids, Michigan, U.S.A., without undue delay and in any event not later than 14 days from the day on which you communicate your withdrawal from this contract to us. The deadline is met if you send back the goods before the period of 14 days has expired. You will have to bear the direct cost of returning the goods. You are only liable for any diminished value of the goods resulting from the handling other than what is necessary to establish the nature, characteristics and functioning of the goods.
Exceptions to the right of withdrawal
The right of withdrawal does not apply to:
- The delivery of newspapers, journals or magazines with the exception of subscription contracts; and
- The supply of digital content which is not supplied on a tangible medium (e.g. on a CD or DVD) if you accepted when you placed your order that we could start to deliver it, and that you could not withdraw once delivery had started.
Shipping terms
We will ship to all domestic and most international destinations.
Please note: Shipping times are estimated and are not guaranteed by BargainBookStores.