TROISINH
Foundations

Level 0: Foundations

30 bài nền tảng — neural network primitives, sequence modeling, training at scale, alignment basics.

Level 0 — Foundations xây dựng nền tảng vững chắc để hiểu mọi thứ phía sau AI hiện đại. Từ backpropagation đến Transformer, từ data parallelism đến RLHF.

Nội dung Level 0

CụmChủ đềSố bài
Neural Network PrimitivesBackprop, activation, dropout, normalization, skip connections7
Sequence & Language ModelingEmbeddings, tokenization, Transformer, attention, autoregressive LM9
Training at ScalePre-training, transfer learning, scaling laws, parallelism, mixed precision7
Alignment & AdaptationSFT, RLHF, reward modeling, LoRA, prompt engineering, CoT7

On this page