Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)N
Posts
0
Comments
25
Joined
2 yr. ago

  • deleted the database

    this is generally something you should avoid doing with activitypub software, as there is no clearly defined way to deal with changed private keys and it is handled differently depending on the software. with lemmy it should more or less resolve itself after some time, as instances will refresh public keys from time to time. after a few days of being alive again and having activities federate out it that part should start working properly again.

    Subscription Pending Issue

    check if your instance is considered dead, it may take sending some activities (e.g. subscribing, posting, commenting) and a bit of waiting to get your instance considered reachable again. you can use https://phiresky.github.io/lemmy-federation-state/site to check the instance you're expecting data from and look for where your instance is listed.

    Old Content Persisting

    as @asudox@lemmy.asudox.dev already mentioned, all you did was disappear. how would anyone know that your intention was to delete data?

    while you can't force other instances to respect your deletion requests, it would still be possible to ask them for it, but this is not an easy task once they're no longer in your database. the most effective/efficient way to do this would probably to first get your overall federation fixed/not considered dead anymore, then delete the account using the same name, and never use the username again on the same domain in the future, as deletions are more pretty much irreversible and depending on the software on the other side may permanently block the username from being used, even if you change this in your database. another option could be creating posts/comments with matching ids in the database and then deleting them via api, but this is also rather fiddly and a lot easier to fuck things up with. i don't recommend editing the db directly without good understanding of lemmy's internals.

    Old Replies Resurfacing

    Lemmy uses numeric incremental ids for posts and comments, so when you started with a fresh database these ids are getting reused. this will break your posts and comments from properly federating to instances that have seen them with the same id before.

    the easiest and lowest tech solution to deal with this would be to simply move to a different domain/subdomain for a proper new instance experience. alternatively you could consider adjusting the sequences in the database used for new post, comment and pm ids, to ensure that they are higher than any number your instance may have previously seen. as they are incremented not only by local content, but also by content retrieved via federation, these numbers will be significantly higher than the amount of content you had posted in the past, but it will be hit or miss whether they will overlap with ids that were for old local content.

    based on counts from lemmy.ml and lemmy.world, it seems that a post sequence starting at 55m is likely safe to use, 20m for comments. pm ids are not publicly visible, but unless you sent or received many in the past, something like 1k or 10k are probably still safe bets. this is a db modification that you will need for sure if you want to minimize federation issues while using the same domain.

    looking at your instance i'm not sure if this is what you mean by replies resurfacing, as i don't see any replies by remote users on your comments, but what i described is otherwise going to cause issues randomly in the future if you happen to hit a previously locally used id on a new local post/comment.

  • i can see rust being a bit more challenging to support properly in an IDE and there still being various special cases not handled properly, and i'm glad that it's free to use non-commercially, but with jetbrains rustrover i frequently see it calling out errors in code that happily compiles, autocomplete being semi-random in how it wants to complete today, which seems to have gotten worse with their recent AI pushes, and even a couple times the entire IDE locking up not too long ago, though i don't remember whether the last part was in rustrover or one of their other IDEs. overall pycharm has been pretty stable for me, as long as you provide it with a pre-existing venv or let it create one for you, as the integration with the latest and greatest(tm) python package manager may not be there yet.

  • honestly at this point I don't consider it worth continuing the discussion here, as it doesn't seem that you understand enough of what you're talking about, despite your claims of dealing with it for "years", yet you keep implying that i'm likely the one being wrong or even lying/misrepresenting things.

    the second screenshot is from the same browser as the first, both are in firefox, using the tor browser variant in safest mode, which blocks even more than the average noscript installation in firefox. tor browser is a hardened variant of firefox esr. if it works in tor browser without loading js from third parties it'll very much do so in any other browser. the screenshot is from macos, which is probably why you're not used to it, but that's just what firefox on macos looks like. this is my standard firefox install:

    besides, if lemmy was loading and executing javascript from other instances, this would be a massive security issue, which is yet another reason why your claim of loading js from other instances is ludicrous for someone who knows how these things work, at least when you keep insisting on it.

    as i mentioned before, noscript is not an extension that is easy to use without some basic understanding of how websites work. if you've been having issues for years due to not understanding these things and how to deal with them properly that suggests that it'd probably be better for you to just switch to something like ublock origin with anti-tracking filter lists if you're not planning to spend some time learning how websites work and what the different types of blocked resources do.

    i don't even see how you would be blocking images with noscript, as there doesn't even seem to be an option for it. unless of course you're confusing noscript with something like umatrix, which does allow blocking images by default as well, but it would also clearly show that there is media blocked and not scripts:

    anyway, if you're truly interested in understanding these things and not just rant about them please do some research on the technology being used.

  • nothing about this is cherry-picking. it's simply how lemmy works. there are no remote js sources. lemmy-ui even sets security headers that prevent loading js from third party domains.

  • doesn't require allowing javascript of a million other servers?

    half the images are broken because I’m expected to allow scripts on like 30+ sites to see most of the posts

    software like noscript is not exactly beginner friendly. you're expected to understand the impact of your blocking and what you are blocking. the only domain you need to allow JS from on lemmy.world is lemmy.world. standard lemmy-ui does not load any js or css from third party sources, only the domain where lemmy-ui is served. your noscript configuration is blocking the actual images, not javascript that would be required to load images.

    edit:

    to expand on this, even in tor browser in safest mode, lemmy.world works totally fine when all you do is allow JS from lemmy.world on lemmy.world:

  • they won't be sent by infosec.pub directly, but other instances may send activities referencing content from infosec.pub, which will lead lemmy.ml to pull it from the source as well.

    this includes for example posts and comments in lemmy.world communities, because lemmy.world will announce those to lemmy.ml.

  • to add to that, Lemmy currently does not handle site bans well if it's not a home instance ban, as instances don't keep track of which other instances have banned which users. this should get better with 1.0 though, as a PR to improve that was recently merged.

    for now, there is a band-aid solution that federates community bans for all communities local to the instance the user got banned from, but that only includes communities that the user previously participated in, so they'll still be able to participate in the local copies of other communities from the instance they're banned from, it just won't fully federate out.

  • You basically can't if your instance was set up before 0.19.4, as there won't be any association between users and uploads for older uploads. You also can't do this without breaking thumbnails everywhere unfortunately.

    The latest Lemmy version has a fix where thumbnails now are actually stored at a reasonable resolution for thumbnails, but old thumbnails may be quite large, and this does not retroactively shrink older thumbnails.

    It's possible to pull image aliases from the DB and ignore them when iterating over aliases within pict-rs, but you these will only be manual uploads, not automatic uploads like generated thumbnails. For posts by local users, deleting thumbnails will also end up breaking them for 0.19.5+ instances, as they should reuse the original thumbnail url.

  • you might find some inspiration from https://breezewiki.com/ - either its codebase directly or using it as an intermediary while scraping

  • ugh, i didn't notice they're even hiding domains of remote communities for "simplicity" in most cases. that seems so much more dishonest tbh.

  • this isn't entirely true, they do have some comments on lemmy as well, here are some examples:

    it seems to be primarily about their communities not federating though i guess?

    and either nobody from there posted a post to a lemmy community yet or maybe it doesn't federate posts currently?

  • lemmy.ml doesn't use cloudflare, that's strange.

    i've also never had issues with this when looking at instances that do use cloudflare.

  • pretty much, yeah. lemmy has a persistent federation queue instead of fire and forget requests when activities get generated. this means activities can be retried if they fail. this allows for (theoretically) lossless federation even if an instance is down for maintenance or other reasons. if mbin has a similar system maybe they could expose that as well, but unless the system is fairly similar in the way it represents this data it will be challenging to integrate it in a view like this without having to create dedicated mbin dashboard.

  • lemmy has a public api that shows the federation queue state for all linked instances.

    it provides the internal numeric id of the last activity that was successfully sent to an instance, as well as the timestamp of the activity that was sent, and also when it was sent. it also includes data like how many times sending was unsuccessful since the last successful send. each instance only knows about its own outbound federation, but you can just collect this information from both sides to get the full picture.

    there is also https://phiresky.github.io/lemmy-federation-state/site to look at the details provided by a specific instance.

  • it's not just lemmy.world.

    of the larger instances, the following have trouble sending activities to lemm.ee currently:

    i pinged @sunaurus@lemm.ee on matrix about 30h ago already about the issues with federation from lemmynsfw.com, as it was the first one i noticed, but I haven't heard back yet.

  • at least the image resizing topic has recently been fixed in lemmy, thumbnails sizes are limited (at the time of thumbnail creation) in the latest release. I'd have to look closer at the other stuff, the api part is unlikely to have changed and will affect all frontends, but js part should differ depending on the front end. some instances already use other frontends by default and there is also a replacement for lemmy-ui being worked on (lemmy-ui-leptos), but I don't know how they compare. either.

    it should be taken into account though how much of this is cacheable as well, as it will then typically only affect the first load for the static files.

    I can totally understand the issues in general though, I've been living with a 64kbps uplink for several years in the past.

  • requires sending ~25-fold less data per post

    what are you referring to with this? AP traffic?

    do you have some more information about this?

  • In one hour, Lemmy.ml will have ~1 hour of downtime for upgrades.

    Jump
  • that is likely related to https://github.com/LemmyNet/lemmy/pull/5107, which limits the resolution of thumbnails.

    the client you are using is probably only displaying the thumbnails to you, not the original images.

    edit: this seems to include lemmy-ui as well

    edit 2: raised a bug report for lemmy-ui