- cross-posted to:
- pcmasterrace@lemmy.world
- cross-posted to:
- pcmasterrace@lemmy.world
You must log in or register to comment.
RAM prices haven’t been normalised they are still rising.
Once again, thanks Madoff Altman for buying up all the chip supply just to monopolize it. I’m never gonna let that go.
Well, the current trajectory points to:
-
LLM capabilities topping out.
-
All the tooling around them not keeping up anyway.
-
Actual “AGI” being distant and completely unrelated to contemporary models.
-
Inference costs plummeting.
The last one is critical.
Right this second, you can run Minimax H3 on a desktop for the tiny fraction of the compute/RAM OpenAI Sora took. And it’s better.
In a month, it will be ~8X faster.
You can run DeepseekV4 flash, dirt cheap, and get what Claude was less than a year ago. And it’s gonna spread to every host out there, to systems like Cerebas ASICs that don’t even need HBM.
So… Even if you’re an AI acolyte. And we go with that for the sake of argument…
We don’t actually need all that RAM for hosting generative models?
I’m very interested to see what happens to all these datacenters over the next two-three years.
They spent all this money on something that’s gonna be cheap as dirt to run, largely run locally, and that won’t need GPUs once bitnet takes off, sooo… they can’t make money off that.
What happens then?
What happens to all those Stargate RAM wafers, and excess datacenters?
Lower inference costs will lead to more demand for RAM
Will it though?
I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that.
The whole pitch from Altman and such is scaling models up. But that’s not working.
What happens to all those Stargate RAM wafers, and excess datacenters?
The bigger question is what happens to the world-economy when the largest players bottom out and the companies betting on them are massively downgraded because of their huge investments in a fantasy about eternal growth. Hope everyone is setting aside extra cash; it’s gonna make 2008 look like a walk in the park.
Traditionally during such busts the government starts outright confiscating bank accounts or otherwise enacts some fiscal policy that renders all savings (especially those in cash) completely worthless in a last bid to pass the buck onto the 99%.
Deepseek v4 Flash is insanely good and basically free. Especially the latest model which I think is only available from China right now.
which I think is only available from China right now.
Nah, 0731 weights were released. I’m running it locally right this second.
I don’t know about Deepseek API specifically, but there are tons of places to get it.
You are Mr. moneybags or you’re running 2 or 4bit quantized.
I have a 3090, 7800, and 128GB frame from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs.
Deepseek V4 is native 4 bit.
I am running this quant, but the quantization loss is measurably low: https://huggingface.co/Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF
The native MXFP4 is only a bit bigger.
-
Gordon Moore is turning in his grave
Look on the bright side. If we hook up a dynamo to his coffin we might be able to power an AI data centre.
About the only upside to this that I can think of is that maybe, just maybe, programmers will start being more frugal with their memory usage. Everything else just sucks.
Nah. They’ll use AI to code everything, and now you need more RAM to continue…
People have to buy the games… if the machine doesn’t support it, nobody to buy it.
Why not rent and stream the games for only $99.99 per month. Subscribe now!
Streaming only replaces storage, you actually need more RAM than running it from fixed memory.
You still need to run streamed games in RAM. A lot of RAM.
Well…we’ll go back to Zork and Venture.
Well… Okay. But only if I can keep paying the subscription fee for the rest of my life in order to maintain access.
That’s why we’ve created the GenPro tier of subscriptions, the first generational loan. Get it now and your kids can help pay of back!
Yeah, I think that’s the running theory of the corporate backup plan if/when AI falls through and they need to find a use for all the data center resources.
They’ll never understand that.
They’ll assume the poor sales have to do with the genre, the subject matter, millennials killing the gaming industry, literally ANYTHING but the actual reason their supposed customers keep yelling about.
The money is micro transactions and the whales have $7k gpus…
Everyone else is just fodder so the pay to win accounts have someone to feel better than.
COD a while ago got caught out for juicing the matchmaking odds right after you buy a new skin. Didn’t matter what you bought or how much. A purchase made your next couple lobbies be filled with scrubs on one side, and you and some above averages on the other.
After X amounts of games it wore off, and since those games pushed you up in the normal metrics, you’re now in lobbies above your skill level. So even if you get a “fair” game, you’re going to do badly, until you buy a skin again or lose to your actual skill level.
That’s why everyone started complaining about COD matchmaking, even if you bought nothing, everyone was on the same micro transaction maximizing rollercoaster.
A cynic would say that’s why it went free on Xbox, they need a population of players to make the whale milking work. Even if those people only fire it up a few hours a month and never buy anything, getting matched with someone above your skill level who just bought a stupid skin makes you the product they sell to the whales.
Everything is a Browser.
No chance.
Of course a chat program needs a 4GB electron app. That’s the bare minimum to match 1990s ICQ.
There are plenty of IRC clients that don’t use electron.
I think it was a comment on the use case for an app not really changing but the resources to run it bloating significantly… E.g. software running on a computer with MB of ram then and now the app alone requiring GB.
did you know Edge has a fucking task manager?
shift-esc to see the bullshit
It’s a fork of chromium, which has it.
AFAIK Firefox also has one.
Yeah so does ff
programmers will start being more frugal with their memory usage.
They 100% will.
Windows had started only “certifying” machines with 32gb as “windows ready” because they wanted the headroom to cram on AI features and use what we pay for instead of a data center.
But because no one was buying 32gb machines and a machine without that sticker will end up with Linux…
They just dropped it, and now they’ll have to keep optimizing for 16gb instead of just letting everything bloat. If they don’t, they risk every entry level machine making people eventually switch to Linux for a much better experience. Windows has to run on entry level or people don’t get sucked in, no one converts to windows later in life.
That’s a huge deal, if 32gb was the default for windows it would be the default for everything. Every game and design/modeling program would feel safe to assume 32gb was the norm. Like, imagine what chrome would do assuming there’s 32gb to play with.
Now they can’t, and they’ll know requiring 32gb will cut off some possible consumers.
It’s not like Windows is the good guys tho, it never should have been 32, and arguably should be 8gb forever, even if it required a lightweight mode. Most people would prefer a super stripped down Windows even with 64gb. Most of the bloat is useless, I could live without any updates after we didn’t have to quit to DOS to launch a game.
No, you only need 4gb to run Win11.
The 32gb referred to gaming PC’s
I am quite amazed at your knowledge and foresight. Really cool!
I never assumed such a scenario where ram limit will limit our infrastructure too. What do you consider will happen with people who are actually needing ram but unable to afford? And that number reaches significantly higher volume, like 60% of population?
Like maybe an open source project of building ram seems feasible?
no one converts to windows later in life
That’s why you gotta start kids off right. Perfect starter laptop is the 10 year old clunker running Mint.
Windows had started only “certifying” machines with 32gb as “windows ready” because they wanted the headroom to cram on AI features and use what we pay for instead of a data center.
Meanwhile as of 4 days ago: https://www.tomshardware.com/software/windows/microsoft-quietly-purges-32gb-of-ram-recommendations-from-its-website-company-reels-from-the-effects-of-the-memory-shortage-as-it-released-8gb-base-models-for-surface-laptops-this-year
Buddy, really?
But because no one was buying 32gb machines and a machine without that sticker will end up with Linux…
They just dropped it,
Did you not understand it or just assume none of the later text kept explaining it so you immediately stopped ready?
It’s not just you, I see this shit all over these days, what the fuck are you people doing?
At this point i don’t see why we would need more RAM for basic OS or web usage tbh.
Like we’ve hit a point where things are covered. Obviously this won’t stop capitalists from doing capitalist bullshit though… and bloat is a thing.
Not going to disagree, but “web usage” is basically everything. You can literally run an entire desktop operating system from 2007 on a virtual machine emulated in JavaScript in your browser now.
Not most. Most only concern themselves with “developer productivity”.
That’s been my hope. Maybe get another wonder like Doom
Or just… Play Doom :)
wonder “like” Doom. Something that is efficiently created in the same capacity as Doom. Doesn’t even have to be a game.
Well theres Doom Emacs ;)
For all the reasons I despise Sam Altman, this is the primary reason. It was shrewd of him to lock up the entire market, but that doesn’t make it any less sociopathic. The entire world is negatively affected by this. What an asshole.
Almost like it was planned to prop up a noncompetitive business model.
