Wrong (it's 350K according to Zuck on insta) and dupe of "Meta will have more than 350.000 Nvidia H100s this year"[0], or "Zuckerberg's Meta Is Spending Billions to Buy 350k Nvidia H100 GPUs"[1]

[0]: https://news.ycombinator.com/item?id=39044911 [1]: https://news.ycombinator.com/item?id=39046193

I doubt they're paying retail prices like the tweet implies. Still can't be a small number if that is true.

https://en.wikipedia.org/wiki/List_of_countries_by_GDP_(nomi...

lol, that's an investment!

I can't wait to not be able to run the trained model.

I should have built a video card company based on VAX designs.

How many "parameters" for the LLaMa3?