

Ok but why ew?


Ok but why ew?


The pitch here was that it wouldn’t have to speak to the manufacturer’s servers. The device, “AI” and data are yours. I may have not been clear here. As someone has already said in these comments, there are models, that exist, designed to run on phones and home servers, they just dont have a ton of comoute power and are limited in that way but i think that’s kinda the point. Most people arent going to be writing code or making heavy requests. Most people would use it to help them with everyday things
The things openai is making comerciales about, like helping figure out your commute and daily needs. Maybe even tracking purchases for tax purposes, some home automation,
Theres is a doctor running his own LLM on a single server cross checking FDA approved drugs and potential uses in un treated diseases. Its not fast but working steadily at its purpose. Maybe your usecase is closer to this.
Im just saying theres no question the current state of “AI” is a terrible consolidation of the worst parts of capitalism and shouldn’t be allowed to continue, but how could LLMs be used responsibly and usefully?


Just curious, do any of you think AI would be more popular if someone was offering as a physical product? As in instead of data center and paying a company to use their model, you pay for an in home server with some sort of base agentic LLM preinstslled that you could then train to your specific needs.
Those usually use a nibbler attachment on a drill which will have s little guard over it so it doesn’t nibble you. No blades to say, more like a tiny shear.
They’re meant for thin sheet metal so they’re pretty strong and not completely devoid of danger, but you can add guards and make it so.
They’re pretty cool for the kiddos and crafting!
Here’s a super over complicated version to understand the concept.
https://www.instructables.com/DIY-Cardboard-Cutting-Machine-The-Bibbler-Nibbler-/
Or can just like get one of these and a drill with a zip tie. Poke thst through a nice solid topped box and cut away.
this thing
Have fun!