RoPE (Rotary positional embeddings) explained: The positional workhorse of modern LLMs
14:06
YouTubeDeepLearning Hero
RoPE (Rotary positional embeddings) explained: The positional workhorse of modern LLMs
Unlike sinusoidal embeddings, RoPE are well behaved and more resilient to predictions exceeding the training sequence length. Modern LLMs have already steered away from sinusoidal embeddings for better alternatives like RoPE. Stay with me in the video and learn about what's wrong with sinusoidal embeddings, the intuition or RoPE and how RoPE ...
52.8K viewsAug 2, 2023
RoFormer: Enhanced Transformer with Rotary Position Embedding RoFormer Paper Review
RoFormer: Enhanced Transformer with Rotary Position Embedding Explained
39:52
RoFormer: Enhanced Transformer with Rotary Position Embedding Explained
YouTubeGabriel Mongaras
7.8K viewsJul 6, 2023
[AI Podcast] RoFormer: Enhanced Transformer with Rotary Position Embedding
7:00
[AI Podcast] RoFormer: Enhanced Transformer with Rotary Position Embedding
YouTubeListening to AI Papers
19 views6 months ago
RoFormer
16:12
RoFormer
YouTubeAIDAS Lab
72 views5 months ago
Top videos
Rotary Positional Embeddings: Combining Absolute and Relative
11:17
Rotary Positional Embeddings: Combining Absolute and Relative
YouTubeEfficient NLP
72.4K viewsAug 8, 2023
Why Rotating Vectors Solves Positional Encoding in Transformers | Rotary Positional Embeddings(ROPE)
23:06
Why Rotating Vectors Solves Positional Encoding in Transformers | Rotary Positional Embeddings(ROPE)
YouTubeExplainingAI
1.7K views2 months ago
Rotary Positional Embeddings Explained | Transformer
20:28
Rotary Positional Embeddings Explained | Transformer
YouTubeOutlier
12K views6 months ago
RoFormer: Enhanced Transformer with Rotary Position Embedding RoFormer Vs Bert
[Neuriton] Buổi 10: RoFormer: Enhanced Transformer with Rotary Position Embedding
1:37:48
[Neuriton] Buổi 10: RoFormer: Enhanced Transformer with Rotary Position Embedding
YouTubeNeuriton
34 views4 months ago
Rotary Positional Embeddings
30:18
Rotary Positional Embeddings
YouTubeData Science Gems
5K viewsAug 5, 2023
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
13:39
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
YouTubeJia-Bin Huang
24.5K viewsOct 19, 2024
Rotary Positional Embeddings: Combining Absolute and Relative
11:17
Rotary Positional Embeddings: Combining Absolute and Relative
72.4K viewsAug 8, 2023
YouTubeEfficient NLP
Why Rotating Vectors Solves Positional Encoding in Transformers | Rotary Positional Embeddings(ROPE)
23:06
Why Rotating Vectors Solves Positional Encoding in Transform…
1.7K views2 months ago
YouTubeExplainingAI
Rotary Positional Embeddings Explained | Transformer
20:28
Rotary Positional Embeddings Explained | Transformer
12K views6 months ago
YouTubeOutlier
RoFormer: Enhanced Transformer with Rotary Position Embedding Explained
39:52
RoFormer: Enhanced Transformer with Rotary Position Embedding E…
7.8K viewsJul 6, 2023
YouTubeGabriel Mongaras
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
13:39
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
24.5K viewsOct 19, 2024
YouTubeJia-Bin Huang
Rotary Position Embedding explained deeply (w/ code)
23:26
Rotary Position Embedding explained deeply (w/ code)
5.6K viewsSep 25, 2024
YouTubeJakZee
Rotary Positional Embedding (RoPE) Explained
22:02
Rotary Positional Embedding (RoPE) Explained
12 views3 months ago
YouTubeMarwan Elghitany
34:38
Rotary Positional Encodings | Explained Visually
6.2K views10 months ago
YouTubeVizuara
0:59
What is Rotary Positional Embedding (RoPE)
14 views4 months ago
YouTubeData Science Made Easy
1:10:55
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm…
115.6K viewsAug 24, 2023
YouTubeUmar Jamil
1:18
RoPE in LLMs Explained in 2 Minutes (Rotary Positional Embed…
2 weeks ago
YouTubeSamvity AI
16:12
RoFormer
72 views5 months ago
YouTubeAIDAS Lab
7:00
[AI Podcast] RoFormer: Enhanced Transformer with Rotary Position …
19 views6 months ago
YouTubeListening to AI Papers
10:49
DoPE: Denoising Rotary Position Embedding
32 views2 months ago
YouTubeKeyur
1:37:48
[Neuriton] Buổi 10: RoFormer: Enhanced Transformer with Rotar…
34 views4 months ago
YouTubeNeuriton
36:41
Integer and Binary Positional Encodings | Journey towards Rota…
3.3K views10 months ago
YouTubeVizuara
7:02
Transformer Positional Embeddings EXPLAINED (Sine & Cosine)
361 views4 months ago
YouTubeProtorials By Saif
1:09
What are Positional Embeddings?
34 views4 months ago
YouTubeData Science Made Easy
9:52
[DS Interface, 홍승규] Rotary Position Embedding for Vision Tra…
65 views4 months ago
YouTubeBK21데이터사이언스와비즈니스포텐셜교육연구단
6:21
Transformer Positional Embeddings With A Numerical Example
26.7K viewsOct 22, 2021
YouTubeMachine Learning with PyTorch
20:34
Positional Encoding in Transformer | Sinusoidal Positional Encoding E…
1.9K views3 months ago
YouTubeExplainingAI
13:57
Transformers Explained: Positional Encoding
2.7K viewsJun 9, 2024
YouTubeVizuara
0:15
Demo cách hoạt động của ROPE - Rotary Position Embedding
629 viewsFeb 18, 2025
YouTubeProtonX
9:50
How do Transformer Models keep track of the order of words? Positi…
14.6K viewsNov 7, 2024
YouTubeSerrano.Academy
11:05
Rotary Positional Embeddings & Rotation Matrix + Python LLM code
565 viewsSep 19, 2024
YouTubeVuk Rosić
4:55
Positional Embedding Transformers explained with numerical example
764 viewsFeb 23, 2024
YouTubeThe ChatGPT Tutor
5:17
Positional Encoding EXPLAINED — How Transformers Understand W…
39 views3 months ago
YouTubePeetha Academy
32:31
Round and Round We Go! What makes Rotary Positional Encoding…
2.1K viewsOct 18, 2024
YouTubeGabriel Mongaras
13:39
How Rotary Position Embedding Supercharges Modern LLMs
72 views11 months ago
bilibiliKraka3en
See more videos
Static thumbnail place holder