Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)M

MTK

@ MTK @lemmy.world

Posts
16
Comments
494
Joined
3 yr. ago

  • Frustratingly bad at self hosting. Can someone help me access LLMs on my rig from my phone

    Jump

  • Ollama + open webui + tailscale/netbird

    Open webui provides a fully functional docker with ollama, so just find the section that applies to you (amd, nvidia, etc) https://github.com/open-webui/open-webui?tab=readme-ov-file#quick-start-with-docker-

    And on that host install netbird or Tailscale, install the same on your phone, in tailscale you need to enable magicdns but in netbird I think it provides dns by default.

    Once the docker is running and both your server and phone are connected to the vpn (netbird or tailscale) you just type the dns of your server in your phone's browser (in netbird it would be "yourserver.netbird.cloud" and in tailscale it would be "yourserver.yourtsnet.ts.net")

    Checkout networkchuck on youtube as he has a lot of simple tutorials.

  • A Love Letter To Internet Relay Chat

    Jump

  • Just one time I want someone to write a love letter to some old technology and for it to just be an actual love letter and just like some psycho who is literally in love with some protocol and they're like talking about how hot the protocol is and how they wish they could just fuck it. Is that too much to ask?

  • Proxmox or Docker?

    Jump

  • There are a few reasons why someone might use Proxmox. It doesn't have to be just security, it can also be different network architectures that don't work as well in Docker and it can also be just greater control over the services which is less comfortable to do in Docker as it's meant to have built images that are running and are ephemeral. There are also certain services that either don't have a pre-built docker and someone might not want to bother with making their own docker infrastructure around it or have technologies that are not well supported or are not well executed in docker.

    There is also the fact that Proxmox is meant to be used in production, which means that it's more stable (than some casual docker rubning on whatever distro they have) and it does have a very low overhead, even if you do use dockers you can use them within Proxmox and it gives you a lot of capabilities that add to stability and manageability.

    Generally speaking if your threat model is very small, you're running this within your private network, and it's not exposed to the internet or anything large like that, then it doesn't really make a big difference and you should probably just use whatever is comfortable for you.

    I personally moved to Proxmox for three reasons which are security, customizability and stability. I felt that within Docker containers it was a lot more annoying to have to pull the images and make my own Docker files and update them and build them every time. I find it easier to have my own server with its dedicated service and that I know how to update and how to modify more properly and that I built from scratch. There is also the advantage that I can use whatever OS I want for different situations. Of course I personally use exclusively Linux but even within that I can use different distros and I can have all kinds of different services running without interfering with one another in any way, and in extreme cases I can have a windows vm.

    And another major factor for me was that I just wanted to learn how to do it. I think it's cool and it was interesting and I have already experienced Docker to a level that I felt comfortable with it and it was time to move on and expand my horizons.

  • What's your 'old person' trait?

    Jump

  • I enjoy carbonated water, my friends say it's a weird old person thing

  • What's a sci-fi thing you feel is achievable with our current level of technology that you'd love to see become a thing?

    Jump

  • Not yet, but I think we might see age reversal drugs in the not so far future.

  • Would you retire at 30 and live frugally?

    Jump

  • Why are you so skeptical? I could spend 40 years doing:

    • hikes
    • walks in nature
    • camping
    • volunteer work
    • going to the beach
    • reading
    • doing diy projects
    • helping others
    • learning new things
    • exploring my country
    • etc

    There is so much more to life than work and paid services.

    And yes, this is a privileged position, but that doesn't make it wrong.

  • Would you retire at 30 and live frugally?

    Jump

  • 65% of your spendings, addmittedly this question is mostly relevant to people that spend at least a somewhat above the median, where they can reduce their lifestyle by 35% and still live, just frugally.

    I'm not sure what you mean by significant hobbies, but personally with the exception of one, all of my hobbies are cheap/free.

  • Home server advice

    Jump

  • Tip, if you have the room for it, looking for second hand servers (as in actual servers with server hardware) is often really useful.

    As you start hosting more stuff you realize that ram and cpu cores are very limited in consumer hardware. With a shitty second hand server you could have more cores and more ram than anything in the consumer category, and you can stick an old GPU on it if you want some better media performance.

    But if you truly believe that you won't spread out and that potentially 64gb ram and 8 cores will suffice, just go ahead and build it however you want. It is no different from a regular build. Get a nice ssd, get a wired ethernet connection and you are like 90% of the way there.

    Edit: everyone else is giving much better advice, ignore my overkill here. For media and simple game servers with a low energy consumption target you are probably better off with a mini pc with an integrated gpu or if you want to future proof a bit, maybe one of those unified memory ones where you ram is also the vram and can produce pretty good performance.

  • Are you more scared of horror when you were younger, or more scared as you got older?

    Jump

  • Both. I always have been and probably always will be easily terrified with horror media.

  • Google’s $45 Million Contract With Netanyahu's Office to Spread Israeli Propaganda

    Jump

  • Straight up evil:

  • Would you retire at 30 and live frugally?

    Jump

  • You can do a lot on a frugal budget

  • What would happen to society if people start to extensively use genetic therapy?

    Jump

  • Either x-men or just less people with genetic diseases. Not sure which one though...

  • DOJ plans to label trans Americans as "mentally defective" to take away their guns

    Jump

  • So also reduced sentences on all crimes under the insanity defense? Or just the parts that fits your agenda?

  • What are the odds that we are all in a simulation?

    Jump

  • Same as the odds that a higher being (a god) exists.

    Can't prove it, can't disprove it. All arguments for it speculative and subjective.

    People claim that it is the most likely option because eventually tech will be so advanced that we could make a world simulation, and then we would make multiples, and therefore the probability of this not being a simulation is low.

    This claim assumes that computers CAN get that complex (no indication that they could) it also assumes that if they could, we would create world simulators (Why? Parts of it sure, but all of it?) And it assumes that sentient beings inside the simulation could never know it (Why?)

    It is as pointless as arguing about god.

  • Would you retire at 30 and live frugally?

    Jump

  • Damn, sounds like a dream

  • Would you retire at 30 and live frugally?

    Jump

  • Good point, but also my question is pointless if you are already living frugally, because that would basically be "would you like more time and money?"

  • Linux phones are more important now than ever.

    Jump

  • Google has stopped releasing essential files—like device trees and driver binaries—with the Android 16 source code. These files are critical for developers to build and maintain custom ROMs, especially for Pixel devices. The new reference device for AOSP is now the virtual “Cuttlefish,” limiting real-device support.

  • Hypothetically, if governments wordwide just suddenly became authoritarian and deleted all records of history, how much history can you recall from memory to re-teach to the next generation?

    Jump

  • "Look kid, all you need to know is that up until 2016 the world was simpler, but then they killed a gorilla which lead to the rise of fascism in 2025"

  • Life frustrations

    Jump

  • Someone here is doing their homework! Work hard enough and maybe one day you will die tragically but you life insurance will leave your children less poor!