In this presentation, I will discuss the design, implementation and engineering experience in building and deploying MegaScale, a production system for training large language models (LLMs) at the scale of more than 10,000 GPUs. Training LLMs at this scale brings unprecedented challenges to training efficiency and stability. Maintaining high efficiency throughout the training process (i.e., stability) is an important consideration in production given the long extent of LLM training jobs. Many ha
0:32
In this presentation, I will discuss the design, implementation and en…
14 viewsJun 5, 2024
FacebookAt Scale
516K views · 6.7K reactions | ⚙️ Extreme Engineering Machines Building The Most Amazing Megastructures ⚙️ There’s something about watching a colossal machine at work that fills us with awe. But is there anything more satisfying than watching something of that scale complete an even more gargantuan task? Let’s check out some of the world’s most extreme engineering machines building amazing megastructures. | Be Amazed | Facebook
13:00
516K views · 6.7K reactions | ⚙️ Extreme Engineering Machines Bu…
516.8K views3 weeks ago
FacebookBe Amazed
Inside The Genius System That Saves Skyscrapers From Disaster
10:05
Inside The Genius System That Saves Skyscrapers From Disaster
12 views2 months ago
YouTubeBoson Buzz
Pillars of Precision Giants at Ground and Sky
0:47
Pillars of Precision Giants at Ground and Sky
710 views2 months ago
YouTubeMEGABUİLD WONDERS
Choreography of Giants: The Engineering Ballet of Megaprojects
0:48
Choreography of Giants: The Engineering Ballet of Megaprojects
1 month ago
YouTubeMEGABUİLD WONDERS
This Mine Is Bigger Than a City 😳 #engineering #megascale #shorts #mining #industry
0:07
This Mine Is Bigger Than a City 😳 #engineering #megascale #shorts …
1 views2 months ago
YouTubeBeyondScale
How complex joint robotic systems are assembled by
0:08
How complex joint robotic systems are assembled by
3 views3 months ago
YouTubeMilitary Robots
15:39
The Dam That Killed 2,000 People in 4 Minutes Italy
92 views1 week ago
YouTubeMegaScale Explained
0:13
“FROM MINI CUTTERS TO MEGA TITANS 🚂💥 | EXTREME MACHINERY …
4 views3 months ago
YouTubeMegascale Universe
8:33
Inside a Mega Factory Testing Godzilla’s Strength | Ultra-Realisti…
73 views1 month ago
YouTubeInside Mega factories
1:25:59
The Orbital Ring A Platform Circling the Entire Earth Why?
1 month ago
YouTubeGalactic Anomalies
0:36
​MEGASCALE ENGINEERING! 🔥#automobile#tractor#trailer#short…
3 views3 months ago
YouTubeHay Dominican
0:49
Colossal Engineers: Giants of Demolition and Construction Reim…
67 views3 months ago
YouTubeMEGABUİLD WONDERS
0:11
I Stuck With Slinky Dog | Toy Story 5 | Abandoned Set
1.7K views1 month ago
YouTubeAI Niches Lab
12:26
Top 10 Hardest Things To Transport: From $200k Body Reco…
2 views1 month ago
YouTubeMegaScale
0:47
Colossal Precision: Machines That Redefine Megaprojects
165 views2 months ago
YouTubeMEGABUİLD WONDERS
11:45
This Insane Ocean Project Is Pushing Nature to Its Limits
29 views1 month ago
YouTubeConstruction Time in English
1:22:50
Why ENERGY and Heat Decide a Matrioshka Brain’s Fate
43 views3 weeks ago
YouTubeFuturistic Technology
0:45
Megacrane Mastery: The Tech Behind Mega Structures
2 months ago
YouTubeMEGABUİLD WONDERS
0:26
18 December 2025
145 views2 months ago
YouTubeSai Solu
0:49
Behemoths of Blueprint The Hidden Tech of Megastructures
14 views1 month ago
YouTubeMEGABUİLD WONDERS
1:34:07
Why We Haven't Built An O'NEILL CYLINDER Yet
32 views1 week ago
YouTubeFuturistic Technology
0:40
Monsters of the Build: The Giants Behind Our Skyscrapers
41 views3 months ago
YouTubeMEGABUİLD WONDERS
MindCraze on Instagram: "They’re not sculpting the mountain — they…
11.3K views4 months ago
Instagrammindcraze2
11:15
FRENCH FRY CHALLENGE!
13M viewsAug 8, 2015
YouTubeRosanna Pansino
16:26
NSDI '24 - MegaScale: Scaling Large Language Model Training to More …
828 viewsJun 4, 2024
YouTubeUSENIX
Megascale Engineering: From Space Elevators to the Great Wall of China
Jul 29, 2022
interestingengineering.com
This Item Is HUGE for My Xtreme OneChunk Ironman! #9
43.2K viewsFeb 20, 2024
YouTubeAgile Tom
5:17
Ship Structure Design
189.7K viewsJan 20, 2010
YouTuberhinoparametrics
2:23
My Paper Bridge
156.9K viewsOct 10, 2010
YouTubeDiego Frank-Arriaga
See more videos
Static thumbnail place holder