Skip to main content
Dantes.io Logo
Dantes.io

Best resources to learnFine-Tuning LLMs

Study sheet

Fine-tuning adapts a pretrained language model to a task or style. You will learn supervised fine-tuning, LoRA and parameter-efficient methods, preference optimisation, datasets and evaluation.

7 resources · · How we curate

🎓Courses(2)

course

Improving Accuracy of LLM Applications

Walks through a systematic loop for making LLM applications reliable: build evaluation metrics, apply prompting and self-reflection, then fine-tune with LoRA and memory tuning. The running example is a text-to-SQL agent that hallucinates less each iteration.

intermediate🇬🇧
course

Hugging Face smol-course: Fine-Tuning Language Models

Hands-on post-training course built around SmolLM3. Units cover instruction tuning, evaluation, preference alignment, vision-language models and reinforcement learning, each with runnable TRL notebooks sized for a single consumer GPU or free Colab. The only free, structured, start-to-finish course dedicated specifically to fine-tuning rather than to LLMs generally. Actively maintained with new units, uses current TRL APIs, and every exercise runs on hardware a learner already has.

beginner🇬🇧

🌐Websites(2)

website

TRL: Transformer Reinforcement Learning Documentation

Reference documentation for the library implementing SFT, DPO, KTO, ORPO, GRPO, reward modelling and distillation trainers. Includes dataset format specifications, memory-reduction and distributed-training how-tos, and PEFT, vLLM and DeepSpeed integration guides.

intermediate🇬🇧
website

Fine-tuning LLMs Guide (Unsloth Documentation)

End-to-end documentation for fine-tuning open models: choosing a base model, LoRA versus QLoRA, dataset formatting, hyperparameter selection, running training in free Colab or Kaggle notebooks, evaluating results, and exporting to GGUF or vLLM.

beginner🇬🇧

📄Papers(3)

paper

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

Derives a closed-form mapping between reward models and optimal policies, replacing the reward-model-plus-PPO pipeline of RLHF with a single classification loss over preference pairs. The reference behind TRL's DPOTrainer and its ORPO and KTO successors.

advanced🇬🇧
paper

QLoRA: Efficient Finetuning of Quantized LLMs

Dettmers and colleagues combine 4-bit NormalFloat quantisation, double quantisation and paged optimisers with LoRA adapters to fine-tune a 65B model on one 48GB GPU. The technical basis for most consumer-hardware fine-tuning stacks in use today. Explains why a 4-bit base model can be fine-tuned without quality collapse, which is the assumption every consumer-GPU tutorial silently relies on. Also contains a still-useful data-quality result: small curated datasets beat large scraped ones.

advanced🇬🇧
paper

LoRA: Low-Rank Adaptation of Large Language Models

Foundational and short. Reading it once removes the guesswork behind rank, alpha and target-module settings that the tutorials present as folklore. Age is irrelevant here — the field's own notation is downstream of this paper. The paper introducing low-rank adaptation: freezing pretrained weights and training rank-decomposition matrices injected into each layer. Reduces GPT-3 175B trainable parameters roughly ten-thousand-fold and adds no inference latency, unlike earlier adapter methods.

advanced🇬🇧
Share this topic

More in Artificial Intelligence

See all 28 topics in Artificial Intelligence →

Frequently Asked Questions

What are the best free resources to learn Fine-Tuning LLMs?

Dantes has curated 7 resources for Fine-Tuning LLMs, including 2 courses, 2 websites, 3 papers. All resources are hand-picked for quality — no algorithmic filler. Browse the full list above to find the format that works best for you.

Is Fine-Tuning LLMs hard to learn?

Fine-Tuning LLMs is approachable at the beginner level — there are resources here specifically for those starting from scratch. As you progress, intermediate and advanced material is also available to take your skills further.

What types of Fine-Tuning LLMs learning resources are available on Dantes?

For Fine-Tuning LLMs, Dantes has curated 2 courses, 2 websites, 3 papers. Each resource type serves a different learning style: videos and YouTube for visual learners, books for depth, courses for structured progression, and websites for quick reference.

How does Dantes select Fine-Tuning LLMs resources?

Dantes is an algorithm-free learning directory. Resources are hand-curated based on quality, accuracy, and usefulness — not engagement metrics or paid placements. The goal is to surface the best learning material for Fine-Tuning LLMs, whether it's a free YouTube series, a classic textbook, or an open courseware from a top university.

Go deeper

Test your understanding of Fine-Tuning LLMs

Explain it out loud. An AI tutor listens and asks questions that expose gaps you didn't know you had.