Skip Navigation

User banner

SmokeyDope

@ Smokeydope @lemmy.world

Posts
39
Comments
304
Joined
3 yr. ago

  • What's the real danger of opening ports?

    Jump

  • Less danger than OPsec nerds hype up but enough of a concern you want at least a reverse proxy. The new FOSS replacement for cloudflare on the block is Anubis https://github.com/TecharoHQ/anubis, while Im not the biggest fan of seeing chibi anime funkopop girl thing wag its finger at me for a second or two as it test connection, I cannot deny the results seem effective enough that all the cool kids on the FOSS circle all are switching to it over cloudflare.

    I just learned how to get my first website and domain and stuff setup locally this summer so theres some network admin stuff im still figuring out. I don't have any complex scripting or php or whatever so all the bots that try scanning for admin pages are never going to hit anything it just pollutes the logs. People are all nuts about scraping bots in current year but when I was a kid allowing your sites to be indexed and crawled was what let people discover it through engines, I don't care if botnets scan through my permissively licensed public writing.

  • GPT-OSS:20B Tool Performance

    Jump

  • Your post inspired me to sit down and get my first little openweather tool calling script just got Hermes 4 14b to properly fetch from the API and tell me the weather! Thanks :)

  • GPT-OSS:20B Tool Performance

    Jump

  • Oooh now that's a good use of tool calling for context fetching! That kiwix integration example you shared is awesome :)

    I'm currently in the building phase for tool integration for a project. I have a goal in mind I want to achieve I'm not that far along though just getting the basic of sending and recieveing input output through API calls. Need to do some work with like getting it to fetch weather and then work up to my real project.

  • I need to contact a Pro Max adult

    Jump

  • Its always been my impression that Lemmy appeals towards politically charged young adults in their 20s and 30s. Theres something about the anti-authoritarian stance of fediverse that appeals to the rebelious angsty liberal arts types. Keep in mind though these are just the most vocal whos opinions youll see most im sure theres plenty of people with good parent relations who just scrolled past without commenting. These types are old enough to realize the flaws of their upbringing and cook it into their woe-is-me victim complex but not yet experienced enough with life to grow past, let it go, and forgive despite. Really I do think having some older kids in your life helps put a perspective on the other side of things. Parenting isn't easy especially when your life isn't going so well to begin with.

  • Just having an eye on it

    Jump

  • Halloween is canceled this year

    Jump

  • "The most opportune time to buy halloween candy is when its 90% off november 1st of last year, the second best time is now" - Sun Tzu

  • How often does your LLM lie to you?

    Jump

  • Thinking of llms this way is a category error. Llms can't lie because they dont have the capacity for intentionality. Whatever text is output is a statistical aggregate of the billions of conversations its been trained on that have patterns in common with the current conversation. The sleeper agent stuff is pure crackpottery they dont have a fine control over them that way (yet) machine model development is full of black boxes and hope-it-works trial and error training. At worst is censorship and political bias which can be post trained or ablated out.

    They get things wrong cofidently. This kind of bullshitting is known as hallucination. When you point out their mistake and they say your right thats 1. Part of their compliance post training to never get in conflict with you 2. Standard course correction once a error has been pointed out (humans do it too). This is an open problem that will likely never go away until llms stop being schastic parrots, which is still very far away.

  • I love my hobbies

    Jump

  • have to remember that expression

    Playing Dwarf Fortress will help with that!

  • I wrote a simple tool chain called 'gem2web' for creating HTML pages for my self-hosted website. I released it publically under GPL3. Source linked inside. (python+shell)

    Jump

  • Similar story here! A couple years ago learning about Gemini/gopher/smallnet from mentaloutlaw videos. So I joined a public access Unix server (first SDF later tilde.team) and learned how to write my own capsule site for a few years. Learned some basic .CGI bin and awk processing to create a gemtext to epub converter that made small ebooks of daily post in atom feed. It was like training wheels really helped prepare me for the transition to full self hosting capsule and website

  • I wrote a simple tool chain called 'gem2web' for creating HTML pages for my self-hosted website. I released it publically under GPL3. Source linked inside. (python+shell)

    Jump

  • Thanks for sharing! It was a good read. They have good points for security and clarity revisions.

    A lot of Gemini spec choices were made to dissuade feature creep. Youre probably never going to do banking through Gemini but its also pretty much gaurenteed you'll never need adblock either.

    Gemini is appealing from the perspective of novice self hosters. Its simple enough that most people can set up a simple server and publish on their site within a few hours. Its minimality enforces maximizing the most reading content for least bits used. 95% of modern webpages isnt even for reading or reference its all back end trackers and scripts and fancy CSS. Newswaffle shows just how bad it is.

    When I read through a gemtext capsule I get the impression I'm looking at something that was distilled into its most essential. No popups no adds no inline images or tracking scripts or complex page layouts. My computer connects to the server, I get back a page of text or an image of a zip file. Once and done.

  • Those who are hosting on bare metal: What is stopping you from using Containers or VM's? What are you self hosting?

    Jump

  • Linux Mint 22

  • Those who are hosting on bare metal: What is stopping you from using Containers or VM's? What are you self hosting?

    Jump

  • Im a hobbiest who just learned how to self host my own static website on a spare laptop over the summer. I went with what I knew and was comfortable with which is a fresh install of linux and installing from the apt package manager.

    As im getting more serious im starting to take another look at docker. Unforunately my OS package manager only has old outdated versions of docker I may need to reinstall with like ubuntu/debian LTS server something with more cutting edge software in repo. I don't care much for building from scratch and navigating dependency roulette.

  • Why is today "rature day"?

    Jump

  • Theres been at least 5 rapture days since ive been alive. Cult members REALLY like the idea that they're super special moral beings with Gods favor. For some reason people get off on the idea everyone they don't like or isn't part of their tribe gets locked out of 'paradise' or better yet actively burns in hell forever. This vengenance fantasy extends to the idea of rapture where God personally singles them out as a favored one for heavenly ascension or whatever. I guess theres something appealing about this concept that really resonates with the kind of people who drink the coolaid, they just can't let go and take the L. So we see the same story every 10 years or so a cult leader predicts the end of the world all their followers give up life savings destroy their life then when the day passes they quietly sweep it under the rug pretend it never happened to save themselves embarrassment.

  • Who would win in a battle to the death, a lion or a knight in full armor?

    Jump

  • Almost certainly the lion, this isn't an anime where a knight can just casually bisect a 800lbs raging bag of muscle with the flick of their wrist and a marketing beam energy swipe. The lion would absolutely knock down, crush, and maul even if it couldn't penetrate armor right away. Like, id give it a 1/50 chance of striking a lucky blow as the lion plunges or if you're smart you might be able to come out alive by going limp and playing dead.

  • getting started in hard mode with very wimpy hardware

    Jump

  • Hey there ThorrJo welcome to our community.

    I recommend you use kobold.cpp as your first inference engine of choice as its very easy to get running especially on Linux. Since you have no GPU you don't need to worry about CUDA or Vulcan for offloading.

    https://github.com/LostRuins/koboldcpp/

    Read the kobold wiki section for vision model projection. For the image recognition model itself I recommend you use Nvidia Cosmos finetune of Qwen2.5-VL. Make sure to load the qwen2.5vl mmproj lens that kobold links along with the model.

    https://github.com/LostRuins/koboldcpp/wiki#what-is-llava-and-mmproj

    https://huggingface.co/koboldcpp/mmproj/tree/main

    https://huggingface.co/mradermacher/Cosmos-Reason1-7B-i1-GGUF

    .GGUF I linked are already pre-quantized, you should be able to load the biggest quant available and the f16 mmproj on your 48gb ram easy with lots of context allocation room left.

    Allocate as much context size as you can. larger high resolution images take more input context to process.

    For troubleshooting if its replies are wonky try changing chat template first I forget if its ChatML or something else. You can try adjusting sampler size too.

    Kobold.CPP runs a web interface you can connect to through the browser on multiple devices. It also exposes its backend through openai-compatable api so you can write your own custom apps for send and receive or use kobold with other frontend software thats compatable with corporate APIs like tinychat if you want to go further.

    If you have any specific questions or need help feel free to reach out :)

  • Looking for a simple personal homepage

    Jump

  • I wrote my own set of tools in python that convert a simple gemtext formatted .gmi file into a static HTML file thats served by apache.

    I'm a big fan of the Gemini Protocol project and found that handwriting pages in gemtext was ideal for focusing on text content and not worrying about formatting. Converting it to HTML+CSS with some scripts is pretty easy.

    If anyone's interested I can give a link, currently just hosting source locally on my website, really should get a public github running.

  • What local, small models are you all using?

    Jump

  • I'm a big fan of NousResearch their deephermes release was awesome and now I'm trying out Hermes 4. I have an 8gb 1070ti GPU was able to fully offload a medium quant of hermes 4 14b with an okay amount of context.

    I'm a big fan of the hybrid reasoning models I like being able to turn thinking on or of depending on scenario.

    I had a vision model document scanner + TTS going on with a finetune of qwen 2.5 vl and outetts.

    If you care more about character emulation for writing and creativity then mistral 2407 and mistral NeMo are other models to check out.

  • email

    Jump

  • Unbothered. Moisturized. Happy. In my lane. Focused. Flourishing.

  • What is a good reusable bottle that isn't a mould farm?

    Jump

  • Tape some bubblewrap around a mason jar taps forhead

  • DeepSeek dropped the V3.1 Weight

    Jump