I’ve been dreaming of local AI for a hot minute. Sadly corporate AI has priced me out of personal computing, and current hardware isn’t up to it.
Maybe my n100 could, I don’t really care how slow it’s generating the tokens if it’s just resetting containers and logging errors.
Does your setup handle automagic updates, how do you handle prompt injection if so? Or, just error correction/logging?
Sure. If you actively turn it on, and all involved know it’s on. But this is always active as far as I’m aware.
I’m guessing it’ll be toggle off, and it’ll toggle itself back on every update.
In other words, they’re taking your data for their use all the time, and sometimes they’ll share your data with you.
I’m sure there’s more than a little Baader-Meinhof happening. I did expand my privacy a bit; pihole, searxng, some other stuff and I notice it less now. Or I think I do, humans are notoriously bad at this.
Honestly, I thought they already did that.
One of my motivations for becoming more privacy minded, was the amount of times a subject of conversation was delivered through an algorithm later.
It was creepy, talk about hose pipes> receive hosepipe content/ads.
deleted by creator
A hosting service for games. Feed it games and it allows you to download them from your server, manage saves, emulate in browser… A bunch of stuff. It’s a good project.
Dopamine management system
Is there a, err, nsfw instance? Asking, like, for a friend.
Flesh and Code had the name ‘Daniel Todd’ repeatedly coming up in whatever model Replika uses.
Ne, mi ankaŭ ne volis lerni esperanton.
I joke, it was fun, esperantists are good people. I did it to ‘cheat’ at being bi-lingual, I don’t think that was the best motivation. Toki pana would’ve been easier.
I went rpi4>n100> a couple n100s and that pi> the dxp4800, I think it’s a pentium, and those n100s. I think I’m ok here, I have networking, compute + local backup, and storage all in their own box.
Eh, I use Gemini to project manage my little herb garden. Low stakes, well trodden ground. It was the kind of thing I knew LLMs could handle for stuff I do know about, so I’m trusting it for something I don’t know about.
Ultimately it doesn’t matter if my herbs live or die, I know I’ll kill them on my own though. Gardening isn’t a skill I want to actively acquire, I just want the herbs. It (the garden) is doing fine. I had some yellow leaves, the bot said to top dress it, I did, no more yellow leaves. So far so good.
Anything beyond the well trodden LLMs are shit at though. I tried to use it to find a specific motorcycle part, discontinued by the manufacturer: it couldn’t. When I wanted it to shop for me, it failed. It seems to be doing well managing this non-commercial project for me.
Besides, it’s just a good way of doing it. For the people that want to DIY: here’s the instructions. For people that just want the thing: here’s the payment instructions.
Sometimes I just want the thing.
I stuck a rPi in their houses that runs pihole+nginx+tailscale. As far as they’re concerned they go to https://jellyfin.example.domain/ and they’re there.
Better yet, they go to http://homarr.notlocal/ and they have nice little icons to click on, that take them to all the front-end services I run.
They get pihole goodness for free. Their homepage is attached to their pihole if they want to pause/stop it.
I’d like to set them up to be more declarative than I have, setup/updating is a pain. Nix is interesting but the learning curve is too steep for the effort I’m willing to put in. As per usual, being lazy will end up being more work for me in the long run.
Who’s hosting your email? I’d like to migrate, I’m just facing a bit of choice paralysis.
Fine, I’ll be the low bar.
Proxmox, I just use the GUI to update
I use community-scripts almost exclusively. Community-scripts cron lxc updater does the heavy lifting. pct enter [lxc]
update
does a bunch of work too.
For Docker, I use a couple lxcs with Dockge on it, the “update” button takes me most of the rest of the way.
Finally, I have a couple remote machines [diet-pi]. I haven’t figured out updating over tailscale yet, so I just go round semi frequently for the apt update && apt upgrade -y
VMs get the apt update && apt upgrade -y too. I keep a bare bones mint VM as a virtual laptop, as I don’t have one. I’ll do what I need to do and if I had to install software I’ll just nuke the VM and go again from the bare bones template.
The answer is found in capitalism. Why are gamers, who have continually been fucked by capitalism, so blind at seeing the obvious. '80s game crash: capitalism. Day one DLC: capitalism. Micro transactions: capitalism. All the hardware being hoovered up, so software costs more at every level, increasing prices for both hardware and software: capitalism.
Who just sits there and makes up fake words, as if they were real? Hmmph. A real loser, that’s who!
Shakespear didn’t deserve that. Nor Dr Suess, actually maybe they both deserved it.
You’re a LEG-END. Legend pronounced leg end.
Sum total of my hardware:
Ugreen dxp 4800, the Pentium one. 32gb ram. My main box: jellyfin, arrs, immich, pihole, nginx, etc… It can’t go down. I don’t think I want an LLM here.
Beelink n100 16gb ram. Local back up, redundant pihole, immich machine learning… Generally under utilised, I’d like to move some services around, does proxmox have an auto balancer?!
Spare no name n100. 8, or 16gb, I can’t remember. Abandoned box, It’s what I would put the LLM on, I did have it reserved for a remote back up.
I think it would need a ram upgrade, see corporate AI pricing me out of personal computing. Currently Amazon has a Crucial 32gb ddr5 sodimm module for £280. Which is too high a price for what I’d use it for.
Oh, and I have an abandoned gaming rig with a gtx970, and some rPi0/3s
I’ve put Ollama on an n100 before. It obviously ate all of that box and made everything on it chug, and it was too slow for human use. But if it’s just generating logs, and resetting containers then I wouldn’t mind how slow it is.