Oracle laid off ~13% of its staff to fund a $300B computing deal with OpenAI. Now, a credit downgrade and $7B in required power grid guarantees put the massive project in jeopardy.
Chinese open-source models are becoming the norm. You don’t need the latest model from ChatGPT (e.g., a Ferrari) to complete your task. A simple Honda will suffice (open-source models), and it uses a lot less energy since it runs on your home or company’s infrastructure.
Because of that, I predict that we’re going to see a lot of financial hardship among AI companies.
it uses a lot less energy since it runs on your home or company’s infrastructure.
A CPU-cycle requires energy no matter where it is. The open source models may be more efficient, or you may distribute the power usage over a greater geographical area. But you’re not using less energy because you’re running the model at home.
Because of that, I predict that we’re going to see a lot of financial hardship among AI companies.
I do like the idea that open source will kill tech giants.
You are correct. OpenAI etc. valuations are based on the difference between revenue and cost. The key part is that open source breaks the monopoly. It stops excessive rent being charged (now or in the future) to use Ai models.
Tech giants will still exist, but closed model advantages won’t.
The expectation is that development costs will get cheaper (model design solidifies), Training costs will get cheaper (no need to retrain the whole model) and running costs will get cheaper (datacenter economies of scale).
All this is still true.
OpenAI, anthropic, Google etc. will generate excessive by being able to charge more than cost because their models are vastly superior.
Datacenter economies of scale do not seem to be panning out, 'cause they’re buying into a RAM cartel who knows they’re desperate.
Coreweave’s reports say that the GPUs are 85% of the cost of a data center, and that they’ll last 6 usable years. This isn’t like building a facility like TSMC, datacenters feel more like COGS than capital to me, and those aren’t businesses I would want anything to do with even if I didn’t think they were all run by conmen who are rapists or racists or both.
Chinese open-source models are becoming the norm. You don’t need the latest model from ChatGPT (e.g., a Ferrari) to complete your task. A simple Honda will suffice (open-source models), and it uses a lot less energy since it runs on your home or company’s infrastructure.
Because of that, I predict that we’re going to see a lot of financial hardship among AI companies.
A CPU-cycle requires energy no matter where it is. The open source models may be more efficient, or you may distribute the power usage over a greater geographical area. But you’re not using less energy because you’re running the model at home.
I do like the idea that open source will kill tech giants.
You are correct. OpenAI etc. valuations are based on the difference between revenue and cost. The key part is that open source breaks the monopoly. It stops excessive rent being charged (now or in the future) to use Ai models.
Tech giants will still exist, but closed model advantages won’t.
If the valuation were based on the marginal cost OpenAI and Anthropic would be worth negative a trillion dollars…
Current marginal cost is certainly negative.
The expectation is that development costs will get cheaper (model design solidifies), Training costs will get cheaper (no need to retrain the whole model) and running costs will get cheaper (datacenter economies of scale).
All this is still true.
OpenAI, anthropic, Google etc. will generate excessive by being able to charge more than cost because their models are vastly superior.
Is likely to be false.
Datacenter economies of scale do not seem to be panning out, 'cause they’re buying into a RAM cartel who knows they’re desperate.
Coreweave’s reports say that the GPUs are 85% of the cost of a data center, and that they’ll last 6 usable years. This isn’t like building a facility like TSMC, datacenters feel more like COGS than capital to me, and those aren’t businesses I would want anything to do with even if I didn’t think they were all run by conmen who are rapists or racists or both.
i thought tech valuations were based off of vibes and social currency