Ravi Sir's Cards › Generative AI
Pre-training vs Instruction tuning
Comparison card: Pre-training vs Instruction tuning. Pre-training: the first, biggest training. The model reads a huge amount of text and learns to guess the next word. Instruction tuning: later training on examples of questions with good answers, often with human feedback (people rate answers).
Read card text
What this card says
Comparison card: Pre-training vs Instruction tuning. Pre-training: the first, biggest training. The model reads a huge amount of text and learns to guess the next word. Instruction tuning: later training on examples of questions with good answers, often with human feedback (people rate answers).
Learn this in the lesson: What Is an LLM? Large Language Models Explained Simply