Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)P
Posts
12
Comments
289
Joined
1 yr. ago

  • You don't

    • Went to army surplus store, got various stuff, also got peace buttons and a headband, took all my hair down (long hair), and wore the military gear all unbuttoned and disordered. There wasn't really a plan for the costume beyond that, but people partway through the night decided I was Ron Kovic, which seemed like it fit even though I had no wheelchair. I had a photo from that night for a while with a friend who was going into the navy, who was dressed up as some kind of special forces man with a big hunting knife, with us standing together him looking like a psychopath and me smiling doing a peace sign. We were the before and the after.
    • The day I cut off my long hair, I invested in a super-sharp suit, and went before work to get it all cut off and get a super-sharp short hair haircut instead. I showed up to work in full suit and tie, neatly shaved, looking like a completely different person. My coworkers kept getting startled because they would look over at my desk and see this suit guy sitting there for some reason instead of me.
    • When I was in my mid 40s I dressed up as an old man. Powder in the hair, glasses, old man clothes, and moved around all slow and careful and looked over my glasses at things. People were alarmed a little bit by how effective and accurate it was lol... like "I don't want to see you this way, stop stop doing that."

    Those three I all enjoyed quite a lot.

  • Actually, incompetent and compromised people are better from Trump's perspective. They're not capable enough to challenge his authority, and they owe him completely, without him they're sunk.

    And you have to be really incompetent in order not to be able to muster a challenge for Trump. The man literally shuffles around shitting his pants and doesn't know the basic facts of almost anything. That's why the whole thing is such a motley assortment of weirdos and failures.

  • Sure. I'm saying I tested it against bz2, looked up some rough details of how it works, and got a sense of what the strengths and weaknesses are, and you are wrong that it is simply "the best." I actually do think it's plausibly "the best" for applications where speed of compression is paramount and you still need decent compression, which is probably a lot of them. Having learned that, I've completed what I wanted to get out of this conversation.

  • Let me revise that statement to - it’s better in every metric (compression speed, compressed size, feature set, most importantly decompression speed) compared to all other compressors I’m aware of, apart from xz and bz2 and potentially other non-lz compressors in the best compression ratio aspect.

    Your Cloudflare post literally says "a new compression algorithm that we have found compresses data 42% faster than Brotli while maintaining almost the same compression levels." Yes, I get that in some circumstances where compression speed is important, this might be very useful. I don't see the point in talking further in circles anymore, thank you for the information.

  • You must be living in a different bubble than me then, because I see zstd used everywhere, from my Linux package manager, my Linux kernel boot image, to my browser getting served zstd content-encoding by default

    Clearly a different bubble lol.

    What distro are you using that uses zstd? Both kernel images and packages seem like a textbook case where compressed size is more important than speed of compression... which would mean not zstd. And of course I checked, it looks like NixOS uses bz2 for kernel images (which is obviously right to me) and gzip (!) for packages? Maybe? I'm not totally up to speed on it yet, but it sort of looks that way.

    I mean I see the benchmarks, zstd looks nice. I checked this:

    https://tools.paulcalvano.com/compression-tester/

    ... on lemmy.world, and it said that lemmy.world wasn't offering zstd as an option, In its estimate, Brotli is way better than gzip, and sort of equivalent with zstd with zstd often being slightly faster in compression. I get the idea, it sounds cool, but it sort of sounds like some thing that Facebook is pushing that's of dubious usefulness unless you really have a need for much faster compression (which, to be fair, is a lot of important use cases).

    Yeah, I think of bz2 as sort of maximal compression at the cost of slower speed, gzip as the standard if you just want "compression" in general and don't care that much, and then a little menagerie of higher performance options if you care enough to optimize. The only thing that struck me as weird about what you were saying was claiming it's better in every metric (instead of it just being a good project that focuses on high speed and okay compression) and a global standard (instead of being something new-ish that is useful in some specific scenarios). And then when I tried both zstd and this other new Facebook thing and they were both worse (on compression) than bz2 which has been around for ages I became a lot more skeptical...

  • What are you basing this all on?

     
        
    $ time (cat optimizer.bin | bzip2 > optimizer.bin.bz2)
    
    real	0m4.352s
    user	0m4.244s
    sys	0m0.135s
    
    $ time (cat optimizer.bin | zstd -19 > optimizer.bin.zst)
    
    real	0m12.786s
    user	0m28.457s
    sys	0m0.237s
    
    $ ls -lh optimizer.bin*
    -rw-r--r-- 1 billy users 76M Oct 20 17:54 optimizer.bin
    -rw-r--r-- 1 billy users 56M Oct 20 17:55 optimizer.bin.bz2
    -rw-r--r-- 1 billy users 59M Oct 20 17:56 optimizer.bin.zst
    
    $ time (cat stocks-part-2022-08.tar | bzip2 > stocks-part-2022-08.tar.bz2)
    
    real	0m3.845s
    user	0m3.788s
    sys	0m0.103s
    
    $ time (cat stocks-part-2022-08.tar | zstd -19 > stocks-part-2022-08.zst)
    
    real	0m34.917s
    user	1m12.811s
    sys	0m0.211s
    
    $ ls -lh stocks-part-2022-08.*
    -rw-r--r-- 1 billy users 73M Oct 20 17:57 stocks-part-2022-08.tar
    -rw-r--r-- 1 billy users 26M Oct 20 17:58 stocks-part-2022-08.tar.bz2
    -rw-r--r-- 1 billy users 27M Oct 20 17:59 stocks-part-2022-08.zst
    
      

    Are you looking at https://jdlm.info/articles/2017/05/01/compression-pareto-docker-gnuplot.html or something? I would expect Lempel-Ziv to perform phenomenally on genomic data because of how many widely separated repeated sequences the data will have... for that specific domain I could see zstd being a clear winner (super fast obviously and also happens to have the best compression, although check the not-starting-at-0 Y axis to put that in context).

    I have literally never heard of someone claiming zstd was the best overall general purpose compression. Where are you getting this?

  • In terms of instances, there simply isn’t any appetite for the type of instances and community culture you want. You are simply in a minority here.

    Severely tempted to code it up and see what the interest level is. IDK, I am lazy also, so let's see. In any case thank you for your constructive input lol.

  • I feel like we’ve had a debate on this before.

    Are we having a debate? I honestly was not aware if so lol

    This would just negate the concept of communities built up by moderators.

    Correct. Moderators should not "own" the communication that goes on in "their" communities, they definitely shouldn't look at people as "their" users as I've heard some of them say before. We are just people. We are allowed to say things. The fact that letting people say things even if the moderators don't want them to, would do damage to their concept, is a flaw with their concept.

    Also, in many case, instances have rules before communities. How does that system work here?

    To a certain extent, it is cultural. At the end of the day, the instance admins can physically control whatever passes through their server. In the old school Usenet sense, someone who was in that role would never modify someone else's message. It just was this kind of wild fascism that would never be done except in the most dire circumstances (there were actually arguments about it when spam started cropping up, some people felt like even removing spam was going too far). Now, even someone who doesn't own the server hardware feels empowered to set "rules" as you say for what people are allowed to say to each other, sometimes very arbitrary and clearly self-serving or etc. In my opinion, success lies somewhere between those two extremes: People generally being able to talk to one another (and the architecture being designed where it's assumed that they're allowed to) even if someone else doesn't like it and wants to make rules against it, but still moderation set up for people who want it to the extent that they want it.

    There's obviously still a need for someone to take responsibility for deleting spam, harassment, or abusive content, and there's going to be a grey area. I feel like, generally, you can let people control their own feeds and moderation that applies to them, and they will probably decide to configure it in a way where the anti-spam protection is applied to their feed and their weird additional arbitrary rules are not. That's what I was saying.

    The creator doesn’t curate it beyond curating what communities are visible in it.

    Yes, I'm aware. I was proposing a new way in which it could work, I know that currently it doesn't work that way. I don't even know that the thing I spitballed is the way to do it, just someone asked how it could work, so I spitballed one possible way.

  • People. What a bunch of bastards.

  • Make it pull instead of push. Each user has way too little control over their own experience in my opinion. To me from an old-school-internet background, it's very weird that a moderator can override what comments you're allowed to see or not allowed to see. I much prefer Bluesky's model, where you pick your moderators, and someone can't override you and decide that certain comments you're not allowed to read just because those comments happened to land within that person's little domain after they were the first to claim the "worldnews" name for their community or whatever.

    How to graft that onto Lemmy is a little bit difficult. It's just a different model. I mean you could have a list of moderators whose decisions you want to block (similar to your list of users you want to block) -- if any of those moderators removed a comment, you can still read it, their decisions just don't affect your feed in any way. That would be a simple hack, sort of a useful check on their "power" if you want to say it that way, although it's definitely a little bit rough approach. Probably a more holistic way would be to restructure how content even gets shared around. I haven't looked at how Piefed does "feeds," but that might be one good approach; let someone create or share a "politics" feed for example, and it can be a modification of someone else's feed ("!news@lemmy.world but take out the Trump stuff" or "block these specific annoying users" or "ignore decisions by these two moderators"), so that it's not a monopoly in terms of who gets to curate and control the content. You could subscribe to !betterpolitics@lemmy.world for example, and it's just the identical posts sourced from !politics@lemmy.world, but with some users that are widely disliked banned, and then also with certain moderators who consistently make bad decisions disabled. That's a lot harder to implement of course... IDK, this is just me thinking out loud about solutions I could see, but hopefully it makes some kind of sense.

  • What do you miss from Reddit?

    Activity in niche communities, but that’s changing slowly.

    Actually, two other things I do miss from Reddit: In the heyday (and even still to some extent now), it was so massive that you could have whole communities of types of real-world people you would never interact with. There is a subreddit for cops, one for air traffic controllers, one for sex workers, one for working historians to answer the general public's questions, and so on. Arnold Schwarzenegger and Ghislaine Maxwell had active Reddit accounts. You could come into contact (in their weird text-box-only way) with people you would never come in contact with, and more to the point you could see what their hivemind looked like and their consensus on public issues. I always liked Reddit's community model better than the twitter "everything goes on the pile" model, because you could have these for-real communities develop, and it was fascinating sometimes to see what they thought of things or watch them in action.

    Edit: Oh, the other thing, AMAs of real public figures, similar idea

  • heavy-handed moderation and echo chambers where any dissenting opinion gets buried

    I have bad news for you lol

    It is fine, Lemmy is far superior. But, their baffling decision to copy Reddit's "lords and peasants" model of moderation has led to a lot of the same moderation rot on Lemmy I am sad to say. It's just in less of a late stage terminal form as it was on Reddit. At least the echo chambers are separate echo chambers, and they can yell across the void at each other. lemmy.ml is pretty much the only community that is severely balkanized to its own isolated community where politics / geopolitics are concerned.

    In general, Lemmy is nice because it is more varied. lemmy.world is the most Reddit-like in terms of having a "hivemind," then there are particular smaller servers with their own cultures going on. It is more quiet but a lot more human in my opinion.

    Enjoy.

  • 🪗

  • 🚢🦜⚓

    You can throw some money at artists periodically, some random $10 donation to whatever their fan site or on merch will probably net them more than a lifetime of listening to their stuff on Spotify, since streaming revenues add up to roughly five atoms of currency per stream or so.

  • If anyone ever tries it, MCA shows up their house with a few of his people.

  • Yes, Lempel-Ziv is incredibly fast in compression. That's because it's a sort of elegant hack from the 1970s that more or less gets lucky in terms of how it can be made to work to compress files. It's very nice. You said "by almost any metric," though, not "by compression speed and literally nothing else." There is a reason web pages default to using gzip instead of zstd for example.

    Absolutely no idea what you're on about with >100 MB. I've used bzip2 for all my hard disk backups for about 20 years now, and I think I broke the 100 MB barrier for local storage at some point during that time.

  • the current state of the art for generic compression by almost any metric

     
        
    $ ls -lh optimizer*
    -rw-r--r-- 1 billy users 76M Oct 19 15:51 optimizer.bin
    -rw-r--r-- 1 billy users 56M Oct 19 15:51 optimizer.bin.bz2
    -rw-r--r-- 1 billy users 60M Oct 19 15:51 optimizer.bin.zstd
    
      

    I mean apparently not.

    (Lempel-Ziv is not the best compression that's currently known by a wide margin. It's very fast and it's nicely elegant but I would expect almost any modern "next gen compression" to be based on Huffman trees at the very core, or else specialized lossy compression. Maybe I am wrong, I'm not super up to speed on this stuff, but zstd is not state of the art, that much I definitely know.)

    Of course this is not better at generic compression because that’s not what it’s for.

    They specifically offered csv as an example of a thing it can handle, that's why I chose that as one of the tests.

  • I strongly suspect that it's a bunch of "machine learning" hooey. If your compression is capable at all, it should be able to spend a few bits on categorizing what the "format" type stuff he's talking about is, and then do pretty much equally well as whatever specialized compressor. I won't say it will never be useful for some kind of data that has patterns and regularity that are not immediately obvious unless you spell it out for the compressor (2d images where there are similarities between the same positions on consecutive lines widely separated in the bytestream for example), but my guess is that this is a bunch of hype and garbage.

    Just out of curiosity, I downloaded it and did the quickstart to test my assumption. Results I got:

     
        
    $ ls -lh reads*
    -rw-r--r-- 1 billy users  27M Oct 19 15:14 reads.csv
    -rw-r--r-- 1 billy users 4.2M Oct 19 15:15 reads.csv.bz2
    -rw-r--r-- 1 billy users 6.7M Oct 19 15:16 reads.csv.zl
    
      

    So yeah I think at least at first look, for general-purpose compression it's trash. IDK. I also tried exactly what it sounds like their use case is, compressing PyTorch models, and it's kinda cool maybe (and certainly faster than bzip2 for those models) but at best it seems like a one-trick pony.

     
        
    $ ls -lh optimizer*
    -rw-r--r-- 1 billy users  76M Oct 19 15:26 optimizer.bin
    -rw-r--r-- 1 billy users  56M Oct 19 15:27 optimizer.bin.bz2
    -rw-r--r-- 1 billy users  53M Oct 19 15:26 optimizer.bin.zl
    
      

    I feel like maybe building Huffman trees based on general-purpose prediction of what comes next, and teaching that how to grasp what the next bits might turn out to be based on what has come before including traversing different formats or even just skipping backwards in the data by specified amounts, might be a better way than whatever this is doing. But doing way worse than bzip2 for simple textual data even when we give it the "format hint" that it's looking for is a sign of problems to me.