You now convert any LLM into a faster one without retraining from scratch.NVIDIA just did this to their 30B model. Here's the trick:1. Duplicate the model into two copies2. Freeze one copy, it just reads the prompt and remembers context3. Train the other copy to write chunks of text at once instead of one word at a time4. Run them togetherThe frozen copy barely costs anything (it's already trained). The new copy only needed ~8% of the original training data to learn the new trick.Result: 2.4x fa
0:13
x.comLior Alexander
You now convert any LLM into a faster one without retraining from scratch.NVIDIA just did this to their 30B model. Here's the trick:1. Duplicate the model into two copies2. Freeze one
Lior Alexander (@LiorOnAI). 122 likes. You now convert any LLM into a faster one without retraining from scratch.NVIDIA just did this to their 30B model. Here's the trick:1. Duplicate the model into two copies2. Freeze one copy, it just reads the prompt and remembers context3. Train the other copy to write chunks of text at once instead of one ...
103.4K views1 day ago
NVIDIA Stock: Real-Time Price Updates
Listen: Nvidia delivers Q4 FY24 earnings call $NVDA
1:03:22
Listen: Nvidia delivers Q4 FY24 earnings call $NVDA
YouTubeYahoo Finance
99K viewsFeb 21, 2024
NVIDIA Stock Price Analysis | Top $NVDA Levels To Watch for February 28th, 2025
9:01
NVIDIA Stock Price Analysis | Top $NVDA Levels To Watch for February 28th, 2025
YouTubeWicked Stocks
9.8K viewsFeb 27, 2025
NVDA EARNINGS LIVE 🔥 $NVDA Reports AI Mega-Quarter | Live REACTION | Nov 19
2:30:16
NVDA EARNINGS LIVE 🔥 $NVDA Reports AI Mega-Quarter | Live REACTION | Nov 19
YouTubeTraderTV Live
56.4K views7 months ago
Related Products
NVIDIA GeForce RTX 3070
NVIDIA SHIELD TV
NVIDIA RTX 3070
#NVIDIA
An Early Preview of AI Agent Workflows on NVIDIA RTX Spark Laptops
An Early Preview of AI Agent Workflows on NVIDIA RTX Spark Laptops
YouTube3 days ago
An Early Look At The Microsoft Surface Laptop Ultra Powered by NVIDIA RTX Spark
An Early Look At The Microsoft Surface Laptop Ultra Powered by NVIDIA RTX Spark
YouTube1 week ago
Nvidia Stock News
BIO Conference with Kimberly Powell
1:38
BIO Conference with Kimberly Powell
YouTubeNVIDIA
9.7K views1 week ago
An Early Preview of Creator Workflows on NVIDIA RTX Spark Laptops
0:50
An Early Preview of Creator Workflows on NVIDIA RTX Spark Laptops
YouTubeNVIDIA
8.4K views1 week ago
NVIDIA's Kimberly Powell at BIO International Convention
1:18
NVIDIA's Kimberly Powell at BIO International Convention
YouTubeNVIDIA
4.5K views1 week ago
Analyzing NVIDIAs Historical Stock Performance
NVIDIA Stock Price Analysis | Top $NVDA Levels To Watch for November 28th, 2025
6:43
NVIDIA Stock Price Analysis | Top $NVDA Levels To Watch for November 28th, 2025
YouTubeWicked Stocks
4.2K views7 months ago
Tech stocks like Nvidia could have major impact on global economy if potential bubble bursts
5:38
Tech stocks like Nvidia could have major impact on global economy if potential bubble bursts
YouTubeCBS News
13.3K views7 months ago
NVIDIA Stock Price Analysis | Top $NVDA Levels To Watch for September 2nd, 2025
9:17
NVIDIA Stock Price Analysis | Top $NVDA Levels To Watch for September 2nd, 2025
YouTubeWicked Stocks
6.6K views10 months ago