LLM training stages

About this app

The same prompt through pretraining, SFT, RLHF/DPO and LoRA: the knowledge comes from pretraining, the later stages mainly shift which answer is likely.

Subject: Neural networks

More from Neural networks

• Agent loop
• Attention Visualiser
• Backpropagation — blame in reverse
• Basin of Attraction
• Your job under AI
• The temperature dial
• Diffusion model — images from noise (3D)
• Embedding Space Explorer (3D)

A VisuApp by heyprof: interactive, free in your browser, no sign-up. What is a VisuApp? · All apps