Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Published 2023-12-18

Download video MP4 360p

Recommendations

50:55

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training
3:04:11

Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm
13:01

Do NOT Learn Kubernetes Without Knowing These Concepts...
06:14

Mamba Language Model Simplified In JUST 5 MINUTES!
58:04

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training
2:59:24

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.
1:26:21

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer
32:31

How Fully Sharded Data Parallel (FSDP) works?
42:53

Segment Anything - Model explanation with code
1:10:55

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU
24:19

A friendly introduction to distributed training (ML Tech Talks)
1:14:29

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math
19:07

Autoscaling in Kubernetes
49:24

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)
54:52

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token
27:12

Variational Autoencoder - Model, ELBO, loss function and maths explained easily!
1:56:20

Let's build GPT: from scratch, in code, spelled out.
31:32

Build Your First Pytorch Model In Minutes! [Tutorial + Code]

Similar videos