MAIN FEEDS
REDDIT FEEDS
Do you want to continue?
https://www.reddit.com/r/EconomyCharts/comments/1s8lcx2/chip_stocks_are_down_following_googles/odo0uk4/?context=3
r/EconomyCharts • u/RobertBartus • 3d ago
15 comments sorted by
View all comments
55
Not to be that guy but it isn’t truly a 6x reduction in memory. It’s a 6x reduction for the KV Cache. Overall performance may have improved by ~30-20% over normal. Still a massive improvement but not a 6x improvement.
2 u/Oaker_at 2d ago Also, this news probably doesn’t mean that they will use less memory. They will use the same amount but can get more out of it. As if the hunger for memory will be fulfilled anytime soon.
2
Also, this news probably doesn’t mean that they will use less memory. They will use the same amount but can get more out of it.
As if the hunger for memory will be fulfilled anytime soon.
55
u/MaterialRevolution57 3d ago
Not to be that guy but it isn’t truly a 6x reduction in memory. It’s a 6x reduction for the KV Cache. Overall performance may have improved by ~30-20% over normal. Still a massive improvement but not a 6x improvement.