I think there's a market for a home AI server that can run an LLM or video gen model behind a web frontend. Not literally a raspberry pi strapped to an H100, but something with lopsided enough specs that people joke it is.
And precisely because it's such a huge headache to do yourself, I think a small company could make a nice business wrapping up used datacenter cards in that sort of server.
I'm doubtful they can, based on current inference prices. An H100 draws about 50W while idling, which is ~$8/month at average US electricity prices. They also draw ~400W while active.
The electricity prices are relevant because if you paid $0 for your H100 and didn't use it a single time, you could buy millions of tokens in inference just on the electricity it draws while idling. If you can't keep that thing saturated through the night, you're probably underwater overnight. Likewise, it's too small to run even the frontier open source models so you need to be able to live with worse models.
Max power matters because you aren't going to run many of those H100s before you blow breakers in most houses. Newer houses in the US are 15A service to non-kitchen breakers, so 1650W (that might be peak rather than continuous, not sure). If you're plugging that into an existing run, you could maybe run 2 before you start blowing breakers? You can't just plug 4 H100s into the wall in a normal house.
Maybe I'm wrong, though. I'd be curious, it'd be neat to run my own inference for something more than what'll run on a 3080.
The median home age ranges from 26 to 63 depending on state, and 100 amp service was common into the 90s. 100A service is probably more common than you think, I'd bet we teeter around them being equally common.
My home still has 100 amp service (as does almost the whole city, most of it is a historic district), but it was built in 1910 so that's not shocking.
> A electrician can plop in a electric car charger for instance, that is a 40-50 amp circuit.
Oh yeah, I was mostly talking about having to upgrade the service to the house from the pole. A new circuit with a single outlet isn't horribly expensive, but needing to upgrade service is pretty rough.
Newer houses yes probably have the overhead. We put in a charger for my wife (because she drives 100 miles a day we needed a pretty beefy level 2) and had to replace our whole panel because 1) we had 125A so failed the load calc and 2) we had the infamous Zinsco panels and the electricians refused to squeeze one in even if we did pass the load calculations. Luckily we had a basement so they only had to extend the circuits a little instead of rerunning them all over the house.
I'd imagine that you can have the power to the board shut off when not in use.
But I never assumed it was to be cost competitive at current token rates. I assumed it was for the same reasons people might use open source hardware. Freedom to tinker, etc.
Basically sounds like a hobo version of PCI-e hotswapping which is a thing on enterprise motherboards but not many consumer boards. Also depends on if the board can actually power off the slots which I'm not sure many are setup to do.
A typical oven plug can offer 9.6kW (so your 24-node H100 can keep your kitchen nice and warm). My furnace was 16.5kW, which once failed in an odd way and was stuck on for about a week. The people living in the house simply opened the windows until I got around to fixing it. I estimate it wasted $400 on the power bill.
There's a really noticeable difference in time frame covered in your examples (80s and 90s) and the one in the comment you're replying to (2010s and 2020s).
Is that just two people with different go-to examples? Or is there something going on here?
(I don't mean this as a leading question to some conclusion in my back pocket, I genuinely have no clue.)
It was accelerated further with things like anti-circumvention clauses in Free Trade agreements (see Cory Doctrow's recent highlighting of this: https://pluralistic.net/2026/01/01/39c3/) and then had more gasoline thrown on the fire in the ZIRP/easy money era post GFC, culminating with the bazooka of stimulus unleashed post-covid.
My best guess is we are now going to witness ~20 years of slow unwind. You can already see signs of this in things like RoW/EM stocks outperforming the S&P, treasury yields diverging from other "safe haven" soverign bonds (e.g. swiss), gold price rising, Europe starting to get serious about addressing the Draghi report's findings, European defence spending increasing, China starting to act like the "adult in the room" wrt the recent Iran/US blow-up etc. Essentially, countries/blocs attempting to re-assert sovereignty that has been willingly diluted over the last ~30 years to mainly America's benefit.
Somewhere else in the comments here, someone else remarked "Individuals perhaps [move to the new models], but not organizations."
That's illustrative. The mechanism by which organizations are forced to update their technology, move to more competitive suppliers, and cut costs is a recession. In one, every business that doesn't do so goes bankrupt, and what's left are the more efficient businesses that have adopted technology effectively.
We haven't had a real recession since 2009. (2020 was an odd case, because it was effectively brought on by government edict and so it actually killed a number of efficient but unlucky sectors while doing nothing to clean out the dead wood in major corporations). The next one is likely to be a doozy, because the economy is filled with bullshit jobs, bullshit corporations, and bullshit products.
This argument is so flawed in many ways, economies are built by people for people. Extrapolate the numbers, let's say in the COVID Pandemic a country, take USA as example, has 10% percentage of their population killed by it, would that be better to the economy?
There's multiple ways to look at the economy, the raw exchange of dollar currency in a debt chase (shit I need to run faster & pay down this stuff!), there's the productivity of industrial output (shit we need to sell more junk and useless crap!), and there's the stock and productivity in optimal life cycles (Damn, that Nokia is a tank!)
If 10% of the population went away, it would affect 1 & 2, but in any true practical lens, there's a ton of cheap empty houses, while on the other hand building repairable stuff that lasts or enough cheaply is where economies move to more complex technologies by saving time and effort in useless endeavour of debt chases or consumption-oriented wasteful productivity
Not OP but, EU economy is being squeezed by China on the industrial and tech front, and by the US on the innovation/startup front. It is clear EU is no longer at the technological/economic frontier like it used to be 10-20 years ago. At the same time there are serious demographic, budgetary and political challenges all across the continent. Dragi's report covers some of these. It feels like the whole system might fall into a crisis soon if measures are not taken
We first became powerful because we did the industrial revolution before anyone else, and used more of that capacity to fight the world (and win) than to fight each other.
When we fought each other, after the industrial revolution, that was the Napoleonic Wars and the two World Wars.
> and ever since the creation of the EU it's been becoming less and less important on the world stage.
I wouldn't say it was "ever since the creation of the EU", but rather "roughly between WW1 and decolonisation". Post-Cold-War the EU has taken over from the former global importance of the member states, e.g. https://en.wikipedia.org/wiki/Brussels_effect
That said, east and South Asia are regaining their multi-millennia history of being the world's dominant power by virtue of having roughly half the total world population.
And to agree up-thread, there's plenty going that can rapidly turn the EU's economy into a disaster if not handled expertly.
There were a lot of European wars between the Napoleonic Wars and the First World War. I agree with your point overall but there was a lot of fighting each other during that timeframe.
Sure, but until then, proportional to each of [population, education/educated workers, capital, instantaneous industrial base, energy supply].
Asia's diverse, but I'd say they seem to be doing pretty well with rapid improvements across all fronts.
In comparison, the US's weaker (not weak-weak, just weaker) areas currently seem to be educated workers, instantaneous industrial base, and energy supply (relative to rapidly growing demand from compute); while the EU's weaker areas currently seem to be capital and energy supply (from supply shock, as it doesn't have the compute). The US and EU both have coming demographic issues, but not as soon as the other stuff becomes more important. People talk about China having demographic issues too, but they're a dictatorship, they can make it shift if they care to.
(And Russia's losing a lot of people, more educated people, capital markets, industrial base, and energy supply).
The big drop in Chinese fertility is going to be very disruptive in the near future, because it is much less gradual than European trends and the retiree/workers ratio is going to spike much harder because of that.
Having full authoritarian control is not gonna change anything now because it is already much too late (action would have been required like 35 years ago).
Best they can do is get through it somewhat smoothly.
edit: This is an even better visualization (projected working age population fraction)
The motivation that the USA entered WWII was not because they were generous, but because the 3rd Reich was effectively becoming a big European nation, so they had to do something to avoid it. A unified Europe is a thread to the USA and Russia and maybe somebody else too.
So you’re saying that the war-ravaged Europe of 1946 that was split by the Iron Curtain and needed Marshall Aid was more powerful and important than today’s EU?
Insane take. But somehow people will go to any lengths to disparage the EU.
Globally in relative terms? Kind of. Sure the gap to the US was huge but it still controlled pretty much entire Africa and much of Asia (with China and Japan obviously not doing great..)
More likely it just slowly declines like Japan. Or if anti-migrant sentiment continues growing at the current rate, it breaks into a race war when the AfD and PFN win the majority of votes in Germany and France respectively.
I dont think these slow indicators and developments hold much water the next few decades. We have seen the first inklings what the brave new multipolar world is going to look like and it does not bode well for much of the world. As long as Russia breaks down before the shit really hits the fan, Europe should be fine(r) than most.
Including the warmongering angry midget next to the US, EU, and China is funny. Russia's economy, before they decided to shoot themselves in the face, was the size of the Netherlands. Whether they are in a recession or not is irrelevant to anyone but them.
Gosh that Polish language scores graph is good. Clean bell curve, slight skew, classic little bump at 100 because the measure is truncated, and then this giant mess at 30 that looks more like something out of a heart rate monitor than a normal distribution.
> this giant mess at 30 that looks more like something out of a heart rate monitor than a normal distribution.
Right, it's as if someone shot the heart with a defibrillator - because that's a good analogy of what is actually happening, given the "arbitrary negative effects for people" failing the exam are basically determining the course of one's future (or at least feel like this to the people and their parents at the time).
In particular, having passed "matura" is the lowest level kind of threshold used (both formally and informally) by employers considering job applicants; much like some higher-skill jobs still require a specific university degree, not having "matura" will cut you out of a large chunk of low-skill and entry-level jobs.
Couple failed "matura" with any kind of criminal record - and the two, I imagine, are probably correlated - and you can be screwed for life, economically speaking. It is a big deal, and teachers know it.
IDK what the current system is, but for my cohort, it was possible to repeat the exam in subsequent years - but like with any kind of degree, chances of someone doing that drop sharply with temporal distance; at some point, people just find a path for their lives and are more interested in present-day challenges than going back to finish some degree.
There's a whole scene around making bots for Starcraft: Broodwar, using an API (BWAPI) that doesn't allow cheating. They're quite good now, better than most humans. But the top bots still can't beat a pro, or even a high ranked ladder player.
It looks like some of these terms aren't indexed (or the site is just too hug of deathed right now), but I'd like to see the graph of like, social media, iot, cryptocurrency, ai.
Yeah, Love2d is a great option for gamedev. It doesn't have the same built-in tools as Godot so you'll need something else for putting together maps (use Tiled [1]), and you'll need to write your own main/render loops (these are just two for loops, nothing fancy).
I watch things from unknown-to-me creators in a private window, then copy the URL over to logged in window if it's any good. Same idea, might be an easier workflow.
Absurd that we have these sorts of workarounds, but of course the view numbers are better if it keeps fishing for just the right kind of clickbait trash that you'll wolf it down endlessly.
When I was a kid, we'd host the pics we want to post on forums on geocities and rename the file extensions to .txt to get past its "no hotlinking images" policy. So it's not like much has changed.
There are a lot of barriers between kids and better solutions, one of which is that anything needs a domain and a server, and that means a credit card.
And precisely because it's such a huge headache to do yourself, I think a small company could make a nice business wrapping up used datacenter cards in that sort of server.