EffNine · Open Toolkit

LLM TRAINING
& ENGINEERING
T O O L K I T

Learn LLMs. Build them. Train them. Evaluate them. Scale them.

Start here — pick one path

01 · START FROM ZERO
02 · BUILD SOMETHING 03 · PLAN A TRAINING RUN
All tools (VRAM, GPU, model, tokens, data, eval…)
CHECK MY GPU CALCULATE VRAM BROWSE KNOWLEDGE MODEL DESIGNER TOKEN BUDGET INFERENCE MEM FIT CHECKER DATA PIPELINE EVAL PLANNER SOURCE LIBRARY

THE PATH

The full journey, end to end. Get a personalized roadmap →

Step 0

Zero Knowledge

Programming, Linux, math fundamentals.
Step 1

Foundations

Python, NumPy, linear algebra, calculus.
Step 2

Machine Learning

Optimization, regularization, evaluation.
Step 3

Deep Learning

PyTorch, tensors, neural networks, training loops.
Step 4

Transformers

Attention, RoPE, decoder-only architecture.
Step 5

Tokenizers

BPE, SentencePiece, vocabulary design.
Step 6

Tiny LM

Train a character-level model from scratch.
Step 7

Small LLM

10M to 100M parameter transformer.
Step 8

Fine-Tuning

SFT, LoRA, QLoRA, DPO.
Step 9

Evaluation

Benchmarks, perplexity, contamination.
Step 10

Optimization

Mixed precision, memory, throughput.
Step 11

Multi-GPU

Data parallelism, FSDP, ZeRO.
Step 12

Deployment

Inference, serving, quantization.
Step 13

Source Library

Papers, docs, and specs behind everything above.

WHAT DO YOU WANT TO DO? — BY TASK

Learn LLMs
Follow the curriculum from zero
Build My Roadmap
Personalized learning path
Plan a Training Run
Configuration & estimates
Check My GPU
Hardware compatibility
Calculate VRAM
Memory requirements estimator
Training Methods
Pretraining, fine-tuning, LoRA
Model Designer
Architecture calculator
Hands-on Projects
Build real LLMs step by step
Troubleshoot
OOM, NaN, slow training

FEATURED INTERACTIVE TOOLS — BY TOOL

Calculator

VRAM Estimator

Estimate memory requirements for your training configuration. Shows weight, gradient, optimizer, and activation breakdown.
Database

GPU Architecture

Structured database of GPU architectures, specifications, and training suitability ratings.
Calculator

Model Designer

Design transformer architectures or reverse-engineer parameters from target size.
Decision Tree

Training Method Selector

Answer questions about your goal and hardware to get a recommended training approach.
Calculator

Token Budget

Calculate training steps or estimate token targets from model size using scaling heuristics.
Planner

Data Pipeline

Generate a customized dataset processing pipeline from collection to versioning.

RECENT UPDATES