Efficient Transformer: A Compilation and Tuning Guide for Block-Sparse Attention
2:56
Efficient Transformer: A Compilation and Tuning Guide for Block-Sparse Attention
5 views6 months ago
YouTube
We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence — whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30x longer than possible previously. Read more: https://openai.com/blog/sparse-transformer/ | OpenAI
0:27
We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence — whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30x longer than possible previously. Read more: https://openai.com/blog/sparse-transformer/ | OpenAI
8K viewsApr 23, 2019
FacebookOpenAI
Longformer: The Long-Document Transformer
26:36
Longformer: The Long-Document Transformer
26.4K viewsApr 20, 2020
YouTubeYannic Kilcher
Giannis Daras: Improving sparse transformer models for efficient self-attention (spaCy IRL 2019)
20:14
Giannis Daras: Improving sparse transformer models for efficient self-attention (spaCy IRL 2019)
3.2K viewsJul 12, 2019
YouTubeExplosion
Attention Approximates Sparse Distributed Memory
27:07
Attention Approximates Sparse Distributed Memory
7.8K viewsOct 20, 2021
YouTubeMITCBMM
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs (Apr 2025)
20:56
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs (Apr 2025)
69 views11 months ago
YouTubeAI Paper Slop
Sparse Attention Vs Self-Attention
16:46
Sparse Attention Vs Self-Attention
494 viewsFeb 15, 2025
YouTubeAI Super Storm
36:05
[Transformer Survey] #2 Sparse Attention
4.2K viewsAug 4, 2021
YouTube서울대학교 산업공학과 DSBA 연구실
18:07
DeepSeek Sparse Attention Explained: 80% Cheaper Long-Context AI
1.9K views1 month ago
YouTubeTales Of Tensors
0:41
Sparse Transformers Redefine AI Efficiency
52 views1 month ago
YouTubeTechnology & AI FutureTech
3:29
What are Sparse Transformers?
1K viewsDec 24, 2023
YouTubeWhat Is It
Transformer Architectures for AI: A Comprehensive Guide | Saurabh Ranjan posted on the topic | LinkedIn
24.9K views3 months ago
linkedin.com
Sparse Matrix in Data Structure
89.2K viewsNov 20, 2023
intellipaat.com
1:02
This AI Breakthrough Changes Everything (Sparse Transformers Explained) #Shorts
7 views4 months ago
YouTubeCollapsedLatents
58:01
"White-Box Transformers via Sparse Rate Reduction" - Sam Buchanan, Research at TTIC
158 views11 months ago
YouTubeTTIC
7:31
Soft Mixture of Experts - An Efficient Sparse Transformer
5.7K viewsAug 4, 2023
YouTubeAI Papers Academy
Depth-Aware Sparse Transformer for Video-Language Learning | Proceedings of the 31st ACM International Conference on Multimedia
Oct 27, 2023
acm.org
0:43
Dense vs Sparse Transformers: A Practical Accuracy and Efficiency Showdown
51 views5 months ago
YouTubeNextGen Play
6:44
Weight-sparse transformers have interpretable circuits (OpenAI Research)
79 views5 months ago
YouTubePaperLens
1:10
This AI Breakthrough Changes Everything (Sparse Attention Explained) #Shorts
1 views3 months ago
YouTubeCollapsedLatents
0:40
Silent Spark Sparse AI Chips Redefine On-Device Intelligence
87 views3 weeks ago
YouTubeLatest Tech Innovations
Video Semantic Segmentation via Sparse Temporal Transformer | Proceedings of the 29th ACM International Conference on Multimedia
Oct 17, 2021
acm.org
57:07
Sparse is Enough in Scaling Transformers (aka Terraformer) | ML Research Paper Explained
24.2K viewsDec 2, 2021
YouTubeYannic Kilcher
1:00
#1022: OpenAI Launches Circuit-Sparsity AI Tools #shorts
5 views5 months ago
YouTubeByteEveryDay
Sparse Dense Transformer Network for Video Action Recognition | Knowledge Science, Engineering and Management
Aug 23, 2022
acm.org
10:15
The Transformer neural network architecture EXPLAINED. “Attention is all you need”
92K viewsJul 5, 2020
YouTubeAI Coffee Break with Letitia
42:03
Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
165 viewsNov 8, 2024
YouTubeArxiv Papers
Vision Transformer with Sparse Scan Prior | Proceedings of the 33rd ACM International Conference on Multimedia
6 months ago
acm.org
17:51
Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction
71 viewsNov 6, 2023
bilibilihave-done
1:20
OpenAI’s “Sparse Circuit” Breakthrough
693 views5 months ago
YouTubeAICKStudio
See more