Techniques

What is Fine-Tuning?

Training a pre-trained AI model on specialized data to improve performance on specific tasks.

Definition

Fine-tuning is the process of taking a pre-trained language model and further training it on a smaller, domain-specific dataset. This adapts the model general knowledge to perform better on particular tasks, follow specific formatting, or adopt a certain style. Fine-tuning is cheaper than training from scratch but more permanent than prompt engineering.

💡 Example

A legal firm might fine-tune an LLM on thousands of legal documents so it better understands legal terminology, citation formats, and reasoning patterns — producing more accurate legal analysis than the base model.

Related concepts

LLM (Large Language Model)

A type of AI trained on massive text datasets to understand and generate human language.

→
LoRA (Low-Rank Adaptation)

An efficient method to fine-tune AI models using much less compute and memory.

→

Explore AI tools

Find tools that use fine-tuning in practice.

Browse all tools → Back to glossary
What is Fine-Tuning?

Fine-tuning is the process of taking a pre-trained language model and further training it on a smaller, domain-specific dataset. This adapts the model general knowledge to perform better on particular tasks, follow specific formatting, or adopt a certain style. Fine-tuning is cheaper than training from scratch but more permanent than prompt engineering.

How does Fine-Tuning work in practice?

A legal firm might fine-tune an LLM on thousands of legal documents so it better understands legal terminology, citation formats, and reasoning patterns — producing more accurate legal analysis than the base model.