Fine-Tuning — AI Glossary

Reference details

Related terms

• LoRA (Low-Rank Adaptation)
• RLHF (Reinforcement Learning from Human Feedback)
• Supervised Fine-Tuning (SFT)
• Synthetic Data
• Parameter-Efficient Fine-Tuning (PEFT)

Example: The question that decides it

A model that will not hold your house JSON format across 50 turns needs fine-tuning: the behaviour is the problem. A model that does not know your Q3 pricing needs retrieval: the knowledge is the problem. Fine-tuning teaches form and style reliably and is a poor and expensive way to install facts, because facts change and weights do not.

Commonly confused with

Fine-tuning adjusts behaviour far more reliably than it adds knowledge. Facts trained into weights cannot be cited, updated or revoked per tenant, and they go stale silently — which is why retrieval, not fine-tuning, is the normal answer to “the model does not know X”.

When to use it

Reach for it when:

• You need a consistent format, tone or structure that prompting keeps missing
• The task is narrow and you have curated examples of it done correctly
• Prompt length has become a recurring cost you want to compile away

Reach for something else when:

• The knowledge changes — you will be retraining forever
• You have a few hundred examples; that usually teaches noise
• You have not yet exhausted prompting and retrieval, which are cheaper to reverse

Referenced by

This term is used by the following ModelRefs references:

• lora fine tuning stack
• full fine tuning stack
• learn fine tuning
• become llm engineer

Continue your research

Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Fine-Tuning — AI Glossary.

• Browse models
• Review providers
• Inspect benchmarks
• Explore workflows
• Learn AI concepts
• Read decision guides
• Review trust and methodology
• Start a decision path