would you laugh at me if I ran gemma-4-26b on a 4 core Xeon, with 32GB RAM, no GPU?
would you laugh at me if I ran gemma-4-26b on a 4 core Xeon, with 32GB RAM, no GPU?
codeberg.org
Local_AI
I have spent a few days tweaking this setup to attain these results:
Although modest, It is great for local parsing and analysis of my self-hosted homelab data where sending logs to external APIs is not desirable.
Typical workflows:
- Log analysis: Piping
journalctloutput to the API for error triage and root cause hypothesis generation. - Configuration synthesis: Generating AdGuard Home rewrite rules, nginx location blocks, or
fstabentries based on defined parameters. - Troubleshooting constraints: Querying for failure modes specific to the local topology (e.g., NFS mount failures over a 1 Gbps unmanaged switch, Tailscale DERUP routing behind CGNAT).
- Alert context: Correlating Beszel/Uptime Kuma notifications with service-specific knowledge (e.g., "mediabox CPU spike while SabNZBd is extracting").