LANGUAGE MODEL CONSOLES
Compare three approaches to language modeling: autoregressive generation, diffusion pretraining, and diffusion inference
AUTOREGRESSIVE
AUTOREGRESSIVE-INFERENCE
SEQUENCE
Thequick
PROBABILITIES
No more predictions needed
2/9 tokens • ready
MASKED PRETRAINING
DIFFUSION-TRAINER
INPUT SEQUENCE
0 tokens masked • Loss calculated only on red tokens
MODEL PREDICTIONS
Predictions will appear here
LOSS CALCULATION
Loss computation results will appear here
Step 0/3 • ready
DIFFUSION INFERENCE
DIFFUSION-INFERENCE
ITERATIVE GENERATION
Step 0/5 • Threshold: 60%
ALL PREDICTIONS
Confidence scores will appear here
Step 0/5 • ready to generate predictions