Transformers

Machine Learning

LoRA Fine-Tuning: A Step-by-Step Guide

A step-by-step LoRA fine-tuning guide with theory, setup, classic LoRA and QLoRA code, evaluation, merging, and practical tips.

ASOasis

May 6, 2026

Read More 8 min

Machine Learning

Mixture-of-Experts (MoE) Architecture: A Practical, Engineer’s Guide

A clear, practical guide to Mixture-of-Experts (MoE) architecture: routing, experts, training stability, distributed systems, and when to use it.

ASOasis

Apr 28, 2026

Read More 7 min

Machine Learning

Fine‑Tuning LLMs with LoRA: A Practical, End‑to‑End Tutorial

Step-by-step guide to fine-tuning LLMs with LoRA/QLoRA using Transformers, PEFT, and TRL—from data prep to deployment.

ASOasis

Mar 24, 2026

Read More 7 min