Sam Altman's argument about RAM utilization is reasonable on a first pass, but misses several key points:
1. people aren't using (GPU) RAM [1] for just running LLMs (in the local model sense), they are using it for other things... games, system displays, other models (Text-to-Speech, Speech Recognition, etc.);
2. being able to run models locally allows them to be used when the internet is down, use them on private data (e.g. medical records, proprietary company data, etc.), including training on that data;
3. the big AI companies are already storing unused GPUs on shelves waiting for their roll-out in data centres, as they can't build the capacity fast enough.
With point (3) that goes against Sam Altman's argument about utilization. The big companies have the hardware, but aren't utilizing it themselves.
[1] And if the argument extends to RAM in general you have all sorts of applications, especially on developer hardware -- editing and compiling software; running local servers; running CAD and other applications; etc.
From a pure efficiency point of view it makes sense to have all our resources pooled and used by whoever needs them at the time. So long as there is always enough to go around, and all the benefits of local computing are kept (though how that works practically if your internet goes offline I don't know) then theoretically, home computers are suboptimal.
But that argument isn't really based on reality. Privacy, offline access, access when you need it, cost... the list goes on. There's many reasons he's wrong, but the core point that it is technically more efficient in the perfect world seems sound.
> the core point that it is technically more efficient in the perfect world seems sound.
It's not "sound", because when do we ever have the perfect world? Instead we have a world controlled by self-serving billionaires like Altman. The perfect world is a red herring.
If you're ever tempted to grant the benefit of the doubt to our tech overlords, please read "Careless People" for example.
I find it odd that you're going out of your way to defend an argument as "reasonable" that by your own admission "isn't really based on reality." I think it's actually more charitable to Altman's intelligence to interpret his argument as self-serving than to interpret his argument as somehow just ignorant.
With your logic we should stop using highways because Hitler built some of them. Try to take step back and see past the trees. In a perfect world encrypted and secure compute and storage would be freely available on-demand.
Will that world ever exist? Probably not due to human nature. Still an interesting thought, even if Altman wants to control said compute or not.
Just to be super clear so you understand my comment: I do NOT agree that Altman should have any control over compute and storage. And neither should it be the only way to use compute and storage.
> With your logic we should stop using highways because Hitler built some of them.
No? Please explain, step by step, how my logic leads to that conclusion.
We obviously need highways, in an imperfect world, regardless of leadership. We don't obviously need to give our RAM to AI vendors. I don't even want to use AI at all, so that would be of no benefit whatsoever to me. And I think that AI is just dumbing down the public. Altman is pretending it's for the public benefit. That's the tall tale told by all the tech overlords. Yesterday John Ternus said "everything we do at Apple is for our users" while crowing about record revenue to stock market analysts. 48% company gross margin!
You clearly didn't read my comment carefully enough. I tried to anticipate and avoid this by ending my comment with:
> Just to be super clear so you understand my comment: I do NOT agree that Altman should have any control over compute and storage. And neither should it be the only way to use compute and storage.
Yet you reply with:
> We don't obviously need to give our RAM to AI vendors.
I don't see the point in continuing this discussion. At least you've proved that you're a human, the LLMs today are better at following a conversation.
What you don't appear to understand is that I was pointing out a disanalogy between the RAM argument and the highways argument, to show that the absurd conclusion you claimed follows from my logic does not actually follow from my logic. When I said, "We don't obviously need to give our RAM to AI vendors," the purpose was not to suggest that you believe we do but rather to contrast with "We obviously need highways."
Let me put it another way: a lot of people think we should build highways, not just Hitler. ;-) In contrast, Sam Altman is the only person who thinks we should dedicate our RAM to data centers. That's why Altman's financial conflict of interest is crucial here. We shouldn't give Altman or Hitler the benefit of the doubt, but we don't even need Hitler to convince people to build highways. Whereas the only reason people are even debating this stupid RAM idea is because Altman suggested it.
You're right that there's no point in continuing this conversation, because you've already violated the HN guidelines and insulted my intelligence, with no justification. https://news.ycombinator.com/newsguidelines.html
If some Joe guy talks about sharing resources it's "booo get lost u commie". If a billionaire talks about deciding for all how to share your resources, it's suddenly fine and dandy.
Better analogy might be that instead of everyone having gas powered generators they run for 14 hours a day, we should put them all in one place and run extension cords to peoples homes.
Most of their wealth is committed in stocks or real estate. Any "unused" wealth is just cash-in-hand, ready to be spent on themselves, or to be used in new investment opportunities.
He doesn't miss these things like gaming or edge cases... He's just talking specifically about how local LLM inference is not economical and he is right.
Anyone choosing between a cloud provider vs local specifically for an LLM has likely noticed this already.
Anyone interpreting this as "Altman wants to take DRAM away from me" or "Altman doesn't understand use case X Y or Z" is just strawmanning.
The most honest interpretation of the quote in the article (if you actually read it) is he says:
1. There's a problem which is the shortage
2. People assume the solution to the problem is just everyone has local inference
3. That won't work because if everyone has local inference there's actually a worse problem because it's less efficient (idle time, partial batch sizes etc) so we'd need even more compute
There's nothing that even remotely suggests he wants to do something nefarious from this quote. If you hate him, find a better reason like the weird cornea scanning cryptocurrency ideas.
A problem of both the Altman post and posts that react on him is that they take efficiency/utility in absolute sense instead of in marginal sense.
There is clearly high marginal utility of the first n GB of RAM in your computer, but then its go down probably faster than for RAM in OpenAI's datacenter. And the market just solves for the equilibrium.
The problem isn't efficiency itself, it's that he thinks he gets to decide it for everyone.
Maybe frontier lab engineers, including CEOs like Altman, think that "AI is the most important and innovative technology, therefore people should follow our lead to get a better life", or something like that.
Policymakers should listen to experts, but people who build the tech shouldn't try to act like politicians.
Technology isn't about making the world as efficient as possible(i don't know what efficiency means and what it's for in the first place), it's there to give people the freedom to be inefficient
Are LLMs the best use
Of ram? Many other extremely beneficial devices for extremely high value use cases are suffering because of this madman trying to corner the market. Show me the value of everything else suffering.
Efficiency and resilience are always in trade-off. Even if there was no other argument it would be worth having local inference as a guard against systemic SPOFs in the big providers.
Let's put gaming and all the other uses for compute that require low latency, etc. off the table and just talk about AI compute. People can and do run open models on their own hardware. Altman is, not unseriously, arguing that this hardware would be better utilized if it were concentrated in data centres rather than distributed into smaller, private clusters that might not reach full utlization.
Now, let's take privacy concerns off the table. OpenAI's complete lack of respect for privacy, authorship, copyright, etc. mean that you simply can't entrust private data to OpenAI. Full stop. Anyone with privacy concerns gets a free pass.
Finally, we're dealing just with people doing LLM computations on data that's not sensitive. Why aren't these people doing things in data centres? There are likely a variety of reasons, but one is likely price. If somebody does a lot of stuff with local models, they've probably found an application where a bigger closed model doesn't offer compelling advantages and the cost, purely in terms of filthy lucre, of running a local model is lower. These are the users Sam Altman can legitimately target. What Altman is arguing is that these people are paying too much.
How should he target them? Become the Steam of compute. Save them money and time. If Altman wants these people's RAM because he can use it more efficiently, he needs to offer them the same services they can get from their own hardware, cheaper, and with less trouble.
I don't understand the backlash against this interview.
When listening to the interview it sounded clear that it was just in context of local inference.
To me it came across as stating that setting up local inference, when dram is limited, is indeed limiting from a global perspective.
I think it's a bit disingenuous to state that his opinion is that we shouldn't have any ram being used for any local purposes.
I agree. I mean, his conflict of interest is obvious, but what he was addressing there has been exaggerated. He made no egregious statement. From a utilitarian perspective the distribution of RAM for local inference purposes is indeed inefficient. I still don't want OpenAI or any other company to be able to hoard huge orders of RAM, but the point applies regardless of OpenAI or Anthropic (or any other company). The knee-jerk reaction from a community that's supposed to be bright was disappointing though.
That’s even worse? That sounds like the power company saying that individuals shouldn’t own solar panels because they might not be getting 100% utilization out of them. Or Big Ag making a similar argument about people with kitchen gardens or smallhold farms. For someone in his position, it’s transparently self-serving and anticompetitive. I for one do not feel bad that he has to compete for RAM with other users, not one bit.
I think the argument being made is fundamentally wrong. It reminds me of the Socialism vs Capitalism models - this idea that centralizing the resources will somehow unlock efficiency. It's also becoming clearly that merely throwing more data, RAM, compute, etc, is not generating significantly better behaviours.
We are far better off with millions of people running lots of little experiments, than a handful of super large companies running a subset of experiments. We really need to get agentic LLMs onto local machines at a reasonable price to really accelerate.
The likes of qwen3.5-0.8b have been super interesting to me, you have this tiny little model that can run on a CPU that can exhibit agentic behaviours (with a lot of tickling) - in the hands of hobbyists is where I suspect we will see some cool updates.
Even putting aside the whole privacy and tuning debates - unless Sam is willing to sell us inference at something near the pre-constrained cost of directly owning the DRAM all he is advocating for is "don't be greedy guys, that's what I'm for. I can be greedy for you!". It's not actually efficient for people to pay huge markups on compute and memory vs letting that same memory site idle some of the time. I mean I guess it's efficient for OpenAIs bank account, but not for anyone else.
the efficiency point is simple. inference providers can use RAM to make money and so they are willing to pay more for it. they don't need to confiscate it. they can outbid consumers and reduce effective consumer demand, which is exactly what they are already doing.
the underlying economics are unescapable. when there was a glut of RAM because no profitable uses existed for it manufacturers shoved it into consumer products because "bigger number is good" but it produces very little utility sitting idle in consumer devices.
Altman leaves out of this the fact that OpenAI has basically tried to corner the market on RAM, trying to lock up 40% of the world’s supply without even guaranteeing that it will follow through on the actual purchase orders. I mean, I think that alone would have at least some impact on the current price for RAM, wouldn’t it?
Hes going to lobby the federal government to confiscate all your RAM, like FDR did with the gold. :|
Its is inefficient for Sam Altman to have Sam Altman. ChatGPT 31.41592 can do everything he does, but better. He will be the first to understand that and make room.
Hopefully he doesn't work out either, since that just means he'll have to eat more, which makes him inefficient. He should live on as few calories as he can. Probably get bound to a chair with the computer screen right in front of him, Wall-E-style, and a tube of Soylent delivering it directly to his stomach in the exact measure.
"People shouldn't be allowed to bicycle for fun. Only utilitarian bicycles should be allowed. For there's too much energy spent manufacturing mountain bikes, tires, converting ski station into bike parks for the summer. That energy and money should instead be directed towards creating more RAM factories and more datacenters for the AI companies".
Where does such an "efficient" argument ends?
P.S: as a bonus question: does anyone know how to differentiate a paid shill from a sycophant?
I have been finding this quite weird, it seems that the real villany was in what was in Sam Altman's mind when he said something that is basically true.
I have seen many explanations of what that was exactly, they are not all agreed on the bad thoughts were, but they are pretty much in agreement that it was a bad thing.
It's like saying 'public transport is more efficient than driving your own car', and the person hearing you say 'you shouldn't own a car, you should use the public transport system I will own.'
But they have not bought everything available. The industry has. No one actor caused the shortage. OpenAI may be the largest single buyer, but they do not make up the majority of the buyers. There is competition for what they provide. So they are not even a sole provider.
If you use the same competitive basis for the public transport advocate analogy, your complaint seems to be that one of the advocates for public transport is building public transport. Not the only one, just one of many.
There is a high demand overall, it is costing people more. What solution do you propose?
Let's all get rid of our personal means of transportation as well, super inefficient to have cars and bikes and such parked for the majority of the time! Some people even buy houses that they're never in! Or they buy kitchen equipment they only use once a month! Or clothes that people only wear for parties! Why even own anything at all!
I am pretty sure Sam has already sold the majority of his personal belongings and only rents whatever he needs when he needs it. What a great example for us all.
> Altman talks about how they’re working on having robots build “self-replicating data centers” (what?!?)
Company that cautions against the paperclip maximizer already at work building the paperclip-maximizing hardware themselves.
Though I appreciate how this would invalidate the last remaining arguments for the "data centers bring local employment" claim, if the security and construction jobs are automated away as well.
Maybe it will be replaced with a new spin: "Data center? What data center? Oh that one... that's just a wild weed, you can't prove it's one of ours..."
> if you have a sufficiently powerful AI tool that is told to “maximize” the creation of paperclips, it might decide the best way to do that is to seize control of all resources
Screw Sam Altman. He's the root cause of this shortage, besides that, how does he justify his car having extra seats that he's not using. Sick and tired of these techbros trying to re-centralize computing all over again whilst stealing left, right and center.
Democracy is inefficient. We should return to feudalism. I for one welcome our techno-feudalist overlords. Send your tax collectors, my tribute of VRAM is ready.
Sam Altman's argument about RAM utilization is reasonable on a first pass, but misses several key points:
1. people aren't using (GPU) RAM [1] for just running LLMs (in the local model sense), they are using it for other things... games, system displays, other models (Text-to-Speech, Speech Recognition, etc.);
2. being able to run models locally allows them to be used when the internet is down, use them on private data (e.g. medical records, proprietary company data, etc.), including training on that data;
3. the big AI companies are already storing unused GPUs on shelves waiting for their roll-out in data centres, as they can't build the capacity fast enough.
With point (3) that goes against Sam Altman's argument about utilization. The big companies have the hardware, but aren't utilizing it themselves.
[1] And if the argument extends to RAM in general you have all sorts of applications, especially on developer hardware -- editing and compiling software; running local servers; running CAD and other applications; etc.
Where are these shelves? Asking for a friend.
> Sam Altman's argument about RAM utilization is reasonable on a first pass
How so? It's obviously self-serving.
You can be self-serving and reasonable.
From a pure efficiency point of view it makes sense to have all our resources pooled and used by whoever needs them at the time. So long as there is always enough to go around, and all the benefits of local computing are kept (though how that works practically if your internet goes offline I don't know) then theoretically, home computers are suboptimal.
But that argument isn't really based on reality. Privacy, offline access, access when you need it, cost... the list goes on. There's many reasons he's wrong, but the core point that it is technically more efficient in the perfect world seems sound.
> the core point that it is technically more efficient in the perfect world seems sound.
It's not "sound", because when do we ever have the perfect world? Instead we have a world controlled by self-serving billionaires like Altman. The perfect world is a red herring.
If you're ever tempted to grant the benefit of the doubt to our tech overlords, please read "Careless People" for example.
I find it odd that you're going out of your way to defend an argument as "reasonable" that by your own admission "isn't really based on reality." I think it's actually more charitable to Altman's intelligence to interpret his argument as self-serving than to interpret his argument as somehow just ignorant.
With your logic we should stop using highways because Hitler built some of them. Try to take step back and see past the trees. In a perfect world encrypted and secure compute and storage would be freely available on-demand.
Will that world ever exist? Probably not due to human nature. Still an interesting thought, even if Altman wants to control said compute or not.
Just to be super clear so you understand my comment: I do NOT agree that Altman should have any control over compute and storage. And neither should it be the only way to use compute and storage.
> With your logic we should stop using highways because Hitler built some of them.
No? Please explain, step by step, how my logic leads to that conclusion.
We obviously need highways, in an imperfect world, regardless of leadership. We don't obviously need to give our RAM to AI vendors. I don't even want to use AI at all, so that would be of no benefit whatsoever to me. And I think that AI is just dumbing down the public. Altman is pretending it's for the public benefit. That's the tall tale told by all the tech overlords. Yesterday John Ternus said "everything we do at Apple is for our users" while crowing about record revenue to stock market analysts. 48% company gross margin!
You clearly didn't read my comment carefully enough. I tried to anticipate and avoid this by ending my comment with:
> Just to be super clear so you understand my comment: I do NOT agree that Altman should have any control over compute and storage. And neither should it be the only way to use compute and storage.
Yet you reply with:
> We don't obviously need to give our RAM to AI vendors.
I don't see the point in continuing this discussion. At least you've proved that you're a human, the LLMs today are better at following a conversation.
I did in fact read and understand your comment.
What you don't appear to understand is that I was pointing out a disanalogy between the RAM argument and the highways argument, to show that the absurd conclusion you claimed follows from my logic does not actually follow from my logic. When I said, "We don't obviously need to give our RAM to AI vendors," the purpose was not to suggest that you believe we do but rather to contrast with "We obviously need highways."
Let me put it another way: a lot of people think we should build highways, not just Hitler. ;-) In contrast, Sam Altman is the only person who thinks we should dedicate our RAM to data centers. That's why Altman's financial conflict of interest is crucial here. We shouldn't give Altman or Hitler the benefit of the doubt, but we don't even need Hitler to convince people to build highways. Whereas the only reason people are even debating this stupid RAM idea is because Altman suggested it.
You're right that there's no point in continuing this conversation, because you've already violated the HN guidelines and insulted my intelligence, with no justification. https://news.ycombinator.com/newsguidelines.html
> In contrast, Sam Altman is the only person who thinks we should dedicate our RAM to data centers.
Then you don't understand the point of OP. You're arguing with a straw man.
> you've already violated the HN guidelines and insulted my intelligence
No, your attention span, Make an effort to understand what I'm saying instead of starting a flame-war, also against the guidelines.
If some Joe guy talks about sharing resources it's "booo get lost u commie". If a billionaire talks about deciding for all how to share your resources, it's suddenly fine and dandy.
I didn't say it's fine and dandy. Obviously his point is flawed in many ways and I said this.
Is #3 true? This seems very inefficient. Aren't futures markets supposed to fix this type of thing?
How would a futures market fix that...?
I sell the GPUs I have now for $2B for the right to buy the same number of GPUs in 10 months for $1.6B when my datacenter is complete
GPUs aren’t liquid like stocks or commodities. There’s no guarantee you’ll be able to get them in 10 months.
Same with ag output, but we have a futures market for that.
I guess corn is more fungible than gpus? Not sure what to tell you.
I am unsure, I heard this for the first time today, and now I have heard it multiple times, with varying changes to what is actually being stockpiled.
Sources for this would be appreciated.
See e.g.:
[1] https://www.business-standard.com/technology/tech-news/what-...
[2] https://venturebeat.com/infrastructure/5-gpu-utilization-the...
[3] https://venturebeat.com/infrastructure/ai-bubble-update-79-o...
[4] https://www.techradar.com/pro/5-utilization-is-a-math-fail-m...
[5] https://www.datacenterdynamics.com/en/news/microsoft-has-ai-... [Nov 2025]
It's really inefficient to let people have access to electricity too.
Running all those lines, people don't even use it all that much.
Much more efficient to put everybody into camps, and simply have the people take turns using electrical appliances operating at 100% duty cycle.
Freight delivery speeds need to be brought down too, 35 MPH maximum.
Food? Give me break, get everyone on a Soylent Green diet.
Better analogy might be that instead of everyone having gas powered generators they run for 14 hours a day, we should put them all in one place and run extension cords to peoples homes.
People using energy is waste, it should go to data centres, energy is limited by entropy, how dare people except Sam lives
>Food.
Ol’ Mao would like to have a word with you.
https://en.wikipedia.org/wiki/People%27s_commune
His wealth is also 95% unused, it should be given away.
most billionaire wealth is unused. this is inefficient.
Most of their wealth is committed in stocks or real estate. Any "unused" wealth is just cash-in-hand, ready to be spent on themselves, or to be used in new investment opportunities.
It should still be taken from then by force and doled out to the poor and hungry.
A nation that doesn’t care for itself is one incident away from revolt.
Is it unused? I assume he's not Scrooge McDuck - chances are whatever money he has is invested in something.
He doesn't miss these things like gaming or edge cases... He's just talking specifically about how local LLM inference is not economical and he is right.
Anyone choosing between a cloud provider vs local specifically for an LLM has likely noticed this already.
Anyone interpreting this as "Altman wants to take DRAM away from me" or "Altman doesn't understand use case X Y or Z" is just strawmanning.
The most honest interpretation of the quote in the article (if you actually read it) is he says:
1. There's a problem which is the shortage
2. People assume the solution to the problem is just everyone has local inference
3. That won't work because if everyone has local inference there's actually a worse problem because it's less efficient (idle time, partial batch sizes etc) so we'd need even more compute
There's nothing that even remotely suggests he wants to do something nefarious from this quote. If you hate him, find a better reason like the weird cornea scanning cryptocurrency ideas.
A problem of both the Altman post and posts that react on him is that they take efficiency/utility in absolute sense instead of in marginal sense.
There is clearly high marginal utility of the first n GB of RAM in your computer, but then its go down probably faster than for RAM in OpenAI's datacenter. And the market just solves for the equilibrium.
The problem isn't efficiency itself, it's that he thinks he gets to decide it for everyone.
Maybe frontier lab engineers, including CEOs like Altman, think that "AI is the most important and innovative technology, therefore people should follow our lead to get a better life", or something like that.
Policymakers should listen to experts, but people who build the tech shouldn't try to act like politicians. Technology isn't about making the world as efficient as possible(i don't know what efficiency means and what it's for in the first place), it's there to give people the freedom to be inefficient
Are LLMs the best use Of ram? Many other extremely beneficial devices for extremely high value use cases are suffering because of this madman trying to corner the market. Show me the value of everything else suffering.
> Many other extremely beneficial devices for extremely high value use cases
If the other use cases are extremely beneficial and extremely high value, surely they can happily pay $1000 for 64 GB of RAM?
The LLM bubble is fuelled by speculation and not current utility.
In short sound logical argument absolutely zero sense of optics or relatability
Or decency, empathy. Because of his actions, someone passionate about computers might not be able to purchase a computer even.
If I go check the largest computer shop in my country, it's adding general electronics now, and very few ram, GPU are available.
This is extremely bad. And this asshole says this. It's just infuriating
Efficiency and resilience are always in trade-off. Even if there was no other argument it would be worth having local inference as a guard against systemic SPOFs in the big providers.
We don't have to hold up paperclips as theoretical anymore. AI needs RAM. All of it. The real life paperclip maximization is RAM chips.
And if we cared even a little bit about efficiency the world would look very different, so we can just stop listening to him anyways
What kind of specs would you need on a local machine to be able to run fairly decent (Opus 5.5-level) models on it?
Let's put gaming and all the other uses for compute that require low latency, etc. off the table and just talk about AI compute. People can and do run open models on their own hardware. Altman is, not unseriously, arguing that this hardware would be better utilized if it were concentrated in data centres rather than distributed into smaller, private clusters that might not reach full utlization.
Now, let's take privacy concerns off the table. OpenAI's complete lack of respect for privacy, authorship, copyright, etc. mean that you simply can't entrust private data to OpenAI. Full stop. Anyone with privacy concerns gets a free pass.
Finally, we're dealing just with people doing LLM computations on data that's not sensitive. Why aren't these people doing things in data centres? There are likely a variety of reasons, but one is likely price. If somebody does a lot of stuff with local models, they've probably found an application where a bigger closed model doesn't offer compelling advantages and the cost, purely in terms of filthy lucre, of running a local model is lower. These are the users Sam Altman can legitimately target. What Altman is arguing is that these people are paying too much.
How should he target them? Become the Steam of compute. Save them money and time. If Altman wants these people's RAM because he can use it more efficiently, he needs to offer them the same services they can get from their own hardware, cheaper, and with less trouble.
I don't understand the backlash against this interview. When listening to the interview it sounded clear that it was just in context of local inference. To me it came across as stating that setting up local inference, when dram is limited, is indeed limiting from a global perspective.
I think it's a bit disingenuous to state that his opinion is that we shouldn't have any ram being used for any local purposes.
I agree. I mean, his conflict of interest is obvious, but what he was addressing there has been exaggerated. He made no egregious statement. From a utilitarian perspective the distribution of RAM for local inference purposes is indeed inefficient. I still don't want OpenAI or any other company to be able to hoard huge orders of RAM, but the point applies regardless of OpenAI or Anthropic (or any other company). The knee-jerk reaction from a community that's supposed to be bright was disappointing though.
That’s even worse? That sounds like the power company saying that individuals shouldn’t own solar panels because they might not be getting 100% utilization out of them. Or Big Ag making a similar argument about people with kitchen gardens or smallhold farms. For someone in his position, it’s transparently self-serving and anticompetitive. I for one do not feel bad that he has to compete for RAM with other users, not one bit.
Why did this post get dropped from the homepage?
I think the argument being made is fundamentally wrong. It reminds me of the Socialism vs Capitalism models - this idea that centralizing the resources will somehow unlock efficiency. It's also becoming clearly that merely throwing more data, RAM, compute, etc, is not generating significantly better behaviours.
We are far better off with millions of people running lots of little experiments, than a handful of super large companies running a subset of experiments. We really need to get agentic LLMs onto local machines at a reasonable price to really accelerate.
The likes of qwen3.5-0.8b have been super interesting to me, you have this tiny little model that can run on a CPU that can exhibit agentic behaviours (with a lot of tickling) - in the hands of hobbyists is where I suspect we will see some cool updates.
> Socialism vs Capitalism models
This is literally one of the world's largest capitalists. The cognitive dissonance is deafening...
Even putting aside the whole privacy and tuning debates - unless Sam is willing to sell us inference at something near the pre-constrained cost of directly owning the DRAM all he is advocating for is "don't be greedy guys, that's what I'm for. I can be greedy for you!". It's not actually efficient for people to pay huge markups on compute and memory vs letting that same memory site idle some of the time. I mean I guess it's efficient for OpenAIs bank account, but not for anyone else.
He's saving the planet, don't you get it? His needs obviously trump ours. /s
the efficiency point is simple. inference providers can use RAM to make money and so they are willing to pay more for it. they don't need to confiscate it. they can outbid consumers and reduce effective consumer demand, which is exactly what they are already doing.
the underlying economics are unescapable. when there was a glut of RAM because no profitable uses existed for it manufacturers shoved it into consumer products because "bigger number is good" but it produces very little utility sitting idle in consumer devices.
Consumer demand hasn't decreased. The demand goes unfulfilled at current market prices.
Altman leaves out of this the fact that OpenAI has basically tried to corner the market on RAM, trying to lock up 40% of the world’s supply without even guaranteeing that it will follow through on the actual purchase orders. I mean, I think that alone would have at least some impact on the current price for RAM, wouldn’t it?
Hes going to lobby the federal government to confiscate all your RAM, like FDR did with the gold. :|
Cold.
Dead.
Hands.
Turns out “right to bear arms” was just a typo for “RAMs”
Right to bear ARMs.
I heard someone say it’s inefficient for Sam to have two kidneys
Some say a heart too.
It's inefficient for the world to have a Sam Altman
Its is inefficient for Sam Altman to have Sam Altman. ChatGPT 31.41592 can do everything he does, but better. He will be the first to understand that and make room.
I do wonder if this applicable for the entire (observable) universe as well...
I believe it is indeed inefficient for the entire (observable) universe to have a Sam Altman.
How many houses owns Sam? How many rooms in those. Maybe he should let homeless people live in them when he's not there.
Or maybe he should live in a one bedroom apartment.
That would be way more efficient.
It would be even more efficient if he spend as little resources as possible for the maximum output possible. So he should just live at work.
Hopefully he doesn't work out either, since that just means he'll have to eat more, which makes him inefficient. He should live on as few calories as he can. Probably get bound to a chair with the computer screen right in front of him, Wall-E-style, and a tube of Soylent delivering it directly to his stomach in the exact measure.
His case his "efficient"? What about this one:
"People shouldn't be allowed to bicycle for fun. Only utilitarian bicycles should be allowed. For there's too much energy spent manufacturing mountain bikes, tires, converting ski station into bike parks for the summer. That energy and money should instead be directed towards creating more RAM factories and more datacenters for the AI companies".
Where does such an "efficient" argument ends?
P.S: as a bonus question: does anyone know how to differentiate a paid shill from a sycophant?
A surpisingly good analogy
You should expand your paragraph into a 30,000 word blog post. Only then is the message efficient.
Sam just wants to make paperclips.
"It's inefficient for people to have leisure time. They would be more productive if they were chained to their desks/tractors/whatever."
I think that's about where the argument ends.
I have been finding this quite weird, it seems that the real villany was in what was in Sam Altman's mind when he said something that is basically true.
I have seen many explanations of what that was exactly, they are not all agreed on the bad thoughts were, but they are pretty much in agreement that it was a bad thing.
It's like saying 'public transport is more efficient than driving your own car', and the person hearing you say 'you shouldn't own a car, you should use the public transport system I will own.'
It's different when the person that says it bought all the cars up and is is actively stripping them down to build a public transport system.
They have no credibility as an impartial analyst.
But they have not bought everything available. The industry has. No one actor caused the shortage. OpenAI may be the largest single buyer, but they do not make up the majority of the buyers. There is competition for what they provide. So they are not even a sole provider.
If you use the same competitive basis for the public transport advocate analogy, your complaint seems to be that one of the advocates for public transport is building public transport. Not the only one, just one of many.
There is a high demand overall, it is costing people more. What solution do you propose?
He caused the panic. https://news.ycombinator.com/item?id=46144582
And sure, they ended up being nonbinding letters of intent to purchase, but it caused a massive market shift, and it seemed like an intentional act.
The solution I propose is that everyone stops listening to Sam Altman.
Let's all get rid of our personal means of transportation as well, super inefficient to have cars and bikes and such parked for the majority of the time! Some people even buy houses that they're never in! Or they buy kitchen equipment they only use once a month! Or clothes that people only wear for parties! Why even own anything at all!
I am pretty sure Sam has already sold the majority of his personal belongings and only rents whatever he needs when he needs it. What a great example for us all.
> Altman talks about how they’re working on having robots build “self-replicating data centers” (what?!?)
Company that cautions against the paperclip maximizer already at work building the paperclip-maximizing hardware themselves.
Though I appreciate how this would invalidate the last remaining arguments for the "data centers bring local employment" claim, if the security and construction jobs are automated away as well.
Maybe it will be replaced with a new spin: "Data center? What data center? Oh that one... that's just a wild weed, you can't prove it's one of ours..."
> if you have a sufficiently powerful AI tool that is told to “maximize” the creation of paperclips, it might decide the best way to do that is to seize control of all resources
Hey don't talk about Sam like that!
This keeps getting posted, but it doesn't seem interesting to discuss. Money is the way we decide how scare resources are allocated.
If Sam wants to buy 16GB of 6 year laptop RAM, he can send me a check for $2000.
Make an offer, Sam! I have 128GB DDR5 in inventory, bidding starts at slightly above what you're willing to pay today.
SA: "Well, first of all, we need to do much better than we are doing now."
Me: This might well be the understatement of the century.
SAL "Sand-boxing works to a point. Then I think monitoring........ works to a further point."
Me: REALLY? You think you should MONITOR your system of agents while it does its work? GEE I wish I'd thought of that!
Screw Sam Altman. He's the root cause of this shortage, besides that, how does he justify his car having extra seats that he's not using. Sick and tired of these techbros trying to re-centralize computing all over again whilst stealing left, right and center.
Better: how does he justify having a car at all, considering it's probably stationary 95% of the time?
Democracy is inefficient. We should return to feudalism. I for one welcome our techno-feudalist overlords. Send your tax collectors, my tribute of VRAM is ready.
Efficient as in "so 'smart' it's retarded"