That title is most definitely a swipe at OpenAI. It seems there’s a theme of two types of platform companies: the closed one that has the “premium” platform, and the open one that gets market share by commodifying the platform.
macOS vs Windows
iOS vs Android
OpenAI vs Meta AI?
Edit: Another observation is Meta seems to open things defensively. Facebook had a rich developer platform until Facebook stopped needing to grab market share. Meta’s VR platform was closed until Apple challenged them with Vision Pro. Then Meta announced open sourcing Horizon OS. I wonder if Meta will truly keep things open if they win, or if it’s more like a case of EEE?
> "This effort pushed our infrastructure to operate across more than 16,000 NVIDIA H100 GPUs, making Llama 3.1 405B the first model in the Llama series to be trained at such a massive scale."
So at 20k a pop (assuming meta has a decent wholesale price from Nividia) they spent $320 MILLION on the 405B model (not including probably 5-10 million in electricity for the training process, water, staff, infra).
Do we think that brings more than 400+ million in value to Meta? I think so. I don't want to do the math, so I'll ask Perplexity to look it up:
> "How much has Meta's valuation increased since they released their first open source model"
Answer (edited):
> Closing price on February 23, 2023: $509.50
> Closing price on October 11, 2024: $573.68
> The increase in stock price is $64.18 per share.
> Total increase = Price increase per share × Number of outstanding shares
> Total increase = $64.18 × 2,534,000,000 = $162,632,100,000
> Meta's stock valuation has increased by approximately $162.63 billion since the release of their first open source model on February 24, 2023.
I wonder when Meta, Microsoft and OpenAI will partner on an open chip design to compete with NVIDIA.
They’re all blowing billions of dollars on NVIDIA hardware with like 70% margin and with triton backing PyTorch it shouldn’t be that hard to move off of CUDA stack.
jameslk ·5 hours ago
macOS vs Windows
iOS vs Android
OpenAI vs Meta AI?
Edit: Another observation is Meta seems to open things defensively. Facebook had a rich developer platform until Facebook stopped needing to grab market share. Meta’s VR platform was closed until Apple challenged them with Vision Pro. Then Meta announced open sourcing Horizon OS. I wonder if Meta will truly keep things open if they win, or if it’s more like a case of EEE?
Show replies
Gee101 ·5 hours ago
Show replies
TechDebtDevin ·4 hours ago
So at 20k a pop (assuming meta has a decent wholesale price from Nividia) they spent $320 MILLION on the 405B model (not including probably 5-10 million in electricity for the training process, water, staff, infra).
Do we think that brings more than 400+ million in value to Meta? I think so. I don't want to do the math, so I'll ask Perplexity to look it up:
> "How much has Meta's valuation increased since they released their first open source model"
Answer (edited):
> Closing price on February 23, 2023: $509.50 > Closing price on October 11, 2024: $573.68 > The increase in stock price is $64.18 per share. > Total increase = Price increase per share × Number of outstanding shares > Total increase = $64.18 × 2,534,000,000 = $162,632,100,000 > Meta's stock valuation has increased by approximately $162.63 billion since the release of their first open source model on February 24, 2023.
They seem to be making the right choices!
Show replies
m_ke ·5 hours ago
They’re all blowing billions of dollars on NVIDIA hardware with like 70% margin and with triton backing PyTorch it shouldn’t be that hard to move off of CUDA stack.
Show replies
dudus ·6 hours ago
Show replies