AI Engineer Cookbook
Home
Chapters
1. Foundation
2. Pretraining
3. Post-training
4. Common Models
5. Applications
6. Training & Inference
7. Compression
8. Multimodal
LLM
2. Pretraining
AI Engineer Cookbook
LLM
1. Foundation
2. Pretraining
3. Post-training
4. Common Models
5. Applications
6. Training & Inference
7. Compression
8. Multimodal
On this page
Definition
Data
Procedure
Continue pretrain
Inference time
Evaluation
Benchmark
PPL
LLM
2. Pretraining
2. Pretraining
Definition
Data
Procedure
Continue pretrain
Inference time
Evaluation
Benchmark
PPL