Skip Navigation

nagaram

@ nagaram @startrek.website

Posts
10
Comments
232
Joined
3 yr. ago

  • 1U mini PC for AI?

    Jump

  • Not really a lot of thought went into rack choice. I wanted something smaller and more powerful than my several optiplexs I had.

    I also decided I didn't want storage to happen here anymore because I am stupid and only knew how to pass through disks for Truenas. So I had 4 truenas servers on my network and I hated it.

    This was just what I wanted at a price I was good with at Like $120. There's a 3D printable version but I wasn't interested in that. I do want to 3D print racks and I want to make my own custom ones for the Pis to save space.

    But this set up is way cheaper if you have a printer and some patience.

  • 1U mini PC for AI?

    Jump

  • Not much. As much as I like LLMs, I don't trust them for more than rubber duck duty.

    Eventually I want to have a Copilot at Home set up where I can feed a notes database and whatever manuals and books I've read so it can draw from that when I ask it questions.

    The problem is my best GPU is my gaming GPU a 5060ti and its in a Bazzite gaming PC so its hard to get the AI out of it because of Bazzite's "No I won't let you break your computer" philosophy, which is why I did it. And my second best GPU is a 3060 12GB which is really good, but if I made a dedicated AI server, I'd want it to be better than my current server.

  • Single board computer for selfhosting

    Jump

  • I just built a mini rack with 3 Thinkcentre tiny PCs I bought for $175 (USD) on eBay. All work great.

  • I know some public schools are shit, but c'mon

    Jump

  • Alternative

    looks inside The absolute least educated read you've ever seen

  • What do I do with a steady supply of styrofoam coolers?

    Jump

  • Fuck, we were talking to an expert

  • Americans who live near state borders,how do you notice you've crossed the border?

    Jump

  • Ya know. I don't know. Every state does this as far as I can tell and so I've never questioned it.

    If I had to guess, its how the DOT or Highway department shills to Tue new governor

    "Hey look boss, we put ya name on da side of Interstate 69 from Illinois!,"

  • What's the worst change made in a movie adaptation of a book?

    Jump

  • The fact that gods and magic also seemingly exist really fucks me up because its explicit in Tue original book that god is just a tool for smarter people (Foundation) to manipulate dumber people (everyone else).

    Obnoxious atheist take? Sure I guess.

    But it feels as if someone rebooted harry potter and made the kids saying something nice about trans people or Jews.

  • What's the worst change made in a movie adaptation of a book?

    Jump

  • Legitimately, if they had just done a "A Foundation Story: Empire" and then just did the genetic dynasty stuff, I don't think any of us would be mad.

    But I don't think general audiences have read much Foundation these days so they would have struggled to set it in that universe without an established Foundation Cinematic Universe.

    Anyways, I'm super excited for Tue Foundation super cut that's just Empire.

  • Best Practice Ideas

    Jump

  • That's what I was thinking too. Ijust feel better having another layer between the open web an my server

  • Best Practice Ideas

    Jump

  • True but I'm wanting to run VMs for specific tasks as well (mostly game servers) and I like to virtualize Linux distros I wanna play with as well as keep a running windows VM for the off chance I need windows ever.

  • Best Practice Ideas

    Jump

  • Apartment is too small and my partner is too noise sensitive to get away with a rack. So my localLLM and Jellyfin encoder plus my NAS exists like this this summer. Temps have been very good once the panels came off.

  • Best Practice Ideas

    Jump

  • Ansible is next on my list of things to learn.

    I don't think I'll need to dedicate all of my compute space to K8s probably just half for now.

  • Best Practice Ideas

    Jump

  • The rats nest is behind it

    I need to re do some of the wiring.

    I have all 4 power cables braided and zip tied together with the single data cable so its nice to pull out and put back into the entertainment center.

    Only problem is I only had four 1 foot Ethernet cables and three 7 foot cables. So I used the 1 footers for the Pis and the 7 footers are bundled up as best I could and neatly hidden.

    I'm waiting on some color coordinated .5 foot cables from Cables and Kits and I will swap the switch and patch panel. I want the Pis to have that one cable and that's it, but I also want all the patch panel ports to work.

  • Best Practice Ideas

    Jump

  • Rack shown

  • Best Practice Ideas

    Jump

  • This is a 52pi 10 inch rack 8U

    I have 4 raspberry Pi4's 4gb running with POE

    Some TP-link gigabit switch with 4/poe ports

    3 Thinkcentre Tiny with a ryzen 5 2400GE 32 gigs ddr4 RAM, 512 Sabrent PCIE Gem 4 NVME boot/VM drive, 512 PNY Sata SSDs for databases

    I have a bigger server for AI stuff and storage. This is just Tue "production" server for my websites and Git repos

    I stole the set up idea from my man Jan Wildeboer

    https://jan.wildeboer.net/2025/05/Cute-Homelab/

  • Best Practice Ideas

    Jump

  • Done. Check parent comment!

  • Best Practice Ideas

    Jump

  • Yeah!

    So i am running these three computers in a set up that let's me manage virtual machines on them from a website with Proxmox.

    I want to play with a tool that let's me run Docker Containers. Containers being a way to host services like websites and web apps without having to make a Virtual machine for each app.

    This has a lot of advantages but I'm trying to use the High Availability feature when you run these on a cluster of computers.

    My problem is that I know I can use the Built In container software in the already clustered Proxmox computers called LXC Linux Containers. However, I want to use a container software called Kubernetes but I would have to build Virtual machines on my servers and then cluster those virtual machines.

    Its a little confusing because I have three physical computers clustered together and I'm trying to then build three virtual computers on them and cluster those. Its an odd thing to do and that's the problem.

  • Best Practice Ideas

    Jump

  • Quality answer. Glad my hunch was backed up by your experience. That's very appreciated.

    I hadn't tried anything with Cloudflared and Kubernetes yet so it would be sick to see it just work.

  • Best Practice Ideas

    Jump

  • Best Practice Ideas

    Jump

  • Fair point. I was also thinking it would be fun to use CoreOS so I can get one step closer to ArchBTW