Skip Navigation

Shimitar

@ Shimitar @downonthestreet.eu

Posts

19
Comments

563
Joined

2 yr. ago

20h ago

K2 Horizon: Open-Source Model Family
Jump
Shimitar @downonthestreet.eu 20h ago
It's pretty limited, with swap I can create groups of models that can live together, much more flexible

2d ago

Quality fixes for Gemma 4 E4B

Jump

Shimitar @downonthestreet.eu 2d ago

Seems more like ollama as approach. More easy but less optimized than llamacpp?

3d ago

K2 Horizon: Open-Source Model Family

Jump

Shimitar @downonthestreet.eu 3d ago

Yes, llama swap also give you a pretty web based statistics of all the calls and runs for every model with t/s and more statistics.

It's pretty neat... You can also load and unload models manually, define groups for models that fit together in vram and so on.

It gives you that automation that people coming from ollama are used to.

under the hood all it does is running llama serve. You convert your models.ini to a yaml file 1:1 (plus a few more flexibility).

3d ago

K2 Horizon: Open-Source Model Family

Jump

Shimitar @downonthestreet.eu 3d ago

Yes but llama server does not unload models to fit a different model. At least, didn't managed to have just llama.cpp swap between models that fill up my vram... The second one would fail load.

3d ago

K2 Horizon: Open-Source Model Family

Jump

Shimitar @downonthestreet.eu 3d ago

Llama.cpp of course! After I did the switch, never looked back. Add llama-swap in front of you switch between models often.

6d ago

Replacing Cloudflare Tunnel with a Selfhosted Towonel Tunnel

Jump

Shimitar @downonthestreet.eu 6d ago

You missed my point?

why can't you just use a wireguard connection between your device and the server, or network?

6d ago

Replacing Cloudflare Tunnel with a Selfhosted Towonel Tunnel

Jump

Shimitar @downonthestreet.eu 6d ago

I don't get the need for those tunnels.

Wouldn't a simple wireguard setup be enough un less you are behind CG-NAT?

Wireguard it's there, free, open source, doesn't rely on any external server or company...

What does these "tunnels" actually add?

3w ago

Selfhosting a printer (and scanner) server with UI

Jump

Shimitar @downonthestreet.eu 3w ago

This won't work for Android windows and such devices. And it's a pain to setup, won't work 100% and some scanners are ven worse .

Scanservejs is the final solution for all platforms.

3w ago

Selfhosting a printer (and scanner) server with UI

Jump

Shimitar @downonthestreet.eu 3w ago

Op want to upload a file to a web GUI and print it from there, not share printers with other computer/ devices.

Also, scanservejs is the the sane web GUI to actually do the same with scanner.

For scanning it make sense as there are no shared scanning solutions across platforms. For printing, it's of little use as other pointed out you can print to cups from anything basically.

But o get the need for a web printing page, as uploading a file and hit print button is a zero setup, and while simple even remote cups printing is not 0% extra setup, you have at the very least to select a printer or hit "share as" and select a print service (android). YMMV

3w ago

What is your weirdest self-hosting problem you've had to solve? For me: Mouse inside the server.

Jump

Shimitar @downonthestreet.eu 3w ago

48 disks seems a nightmare in power consumption, failure rate, and overall cabling management....

What was the total capacity?

3w ago

What is your weirdest self-hosting problem you've had to solve? For me: Mouse inside the server.

Jump

Shimitar @downonthestreet.eu 3w ago

I use e self made wood cabinet in the attic where also the PV inverter is located. I used Velcro to strip on the wall (brick wall) stuff like switch firewall etc, only to find those collapsed on the server itself every time. No matter which glue or adhesive i used.

At the end, a strong unbranded Chinese double sided tape was better and still strong after all big western brand failed over time.

Maybe a mix of heat and uneven surface was the culprit, who knows.

3w ago

A solar powered website that goes offline when there's no power

Jump

Shimitar @downonthestreet.eu 3w ago

Uptime for home users is useless. More important is recovery, reboot and resume (the 3'Rs)

You server should reboot automatically, storage should restore itself from unsafe shutdown and your services should resume operations like nothing happened.

This means test your reboot, ensure stuff doesn't break, and so on.

Failing storage after an hard reboot is the hardest.

For network, i have two ISP connections and a an auto switch script Incase one goes down. But honestly it's overkill and not needed for 99% of home hosters.

Buying some kind of UPS like a battery powered power strip is also nice but keep in mind that require maintenance to replace batteries once every few years (long enough to forget) and so be useless. The ups shall only last enough to perform a controlled server shutdown using NUTS.