Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
We Distribute
  1. Home
  2. Technical Discussion
  3. I would like to give an update on "federation" on Bluesky.

I would like to give an update on "federation" on Bluesky.

Scheduled Pinned Locked Moved Technical Discussion
176 Posts 51 Posters 17.5k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • mcc@mastodon.socialM mcc@mastodon.social

    So. The thread above. An update.

    We finally got a live test of the "Gertrude scenario", when a popular Blacksky user got permbanned by Bluesky. I, using my own PDS and blacksky's website, can't see him or his posts ( https://blacksky.community/profile/did:plc:2aebn3xk5t63net43eeepire/post/3m2iokicegs2b ). What gives?

    A lot of people claim this is because Blacksky really is using Bluesky's appview, and gave me a way to verify this looking at headers. This seems to contradict Rudy's previous claims. I've asked Rudy for clarification: https://bsky.app/profile/did:plc:2aebn3xk5t63net43eeepire/post/3m2jve23cf22m

    ellyxir@humanwords.ccE This user is from outside of this forum
    ellyxir@humanwords.ccE This user is from outside of this forum
    ellyxir@humanwords.cc
    wrote on last edited by
    #164

    @mcc@mastodon.social amazing thread. so clear even explaining what you’re not clear about. but it does make me feel like it shouldn’t be this complicated. i haven’t looked at atproto but everything i read makes me not want to.

    mcc@mastodon.socialM 1 Reply Last reply
    0
    • ellyxir@humanwords.ccE ellyxir@humanwords.cc

      @mcc@mastodon.social amazing thread. so clear even explaining what you’re not clear about. but it does make me feel like it shouldn’t be this complicated. i haven’t looked at atproto but everything i read makes me not want to.

      mcc@mastodon.socialM This user is from outside of this forum
      mcc@mastodon.socialM This user is from outside of this forum
      mcc@mastodon.social
      wrote on last edited by
      #165

      @ellyxir I honestly don't think their architecture is very good

      1 Reply Last reply
      0
      • jdp23@neuromatch.socialJ jdp23@neuromatch.social

        @mcc it's certainly possible! I didn't think they were running a separate appview yet but I could easily be wrong.

        (blacksky.community is currently a fork of the Blluesky app-aka-client, it hasn't diverged much yet. not sure if and when they're planning on writing their own implementation of that)

        jdp23@neuromatch.socialJ This user is from outside of this forum
        jdp23@neuromatch.socialJ This user is from outside of this forum
        jdp23@neuromatch.social
        wrote on last edited by
        #166

        @mcc mmmmkay it looks like Rudy is now in the process of "standing up an app.bsky.* API server" (aka appview) which "Is different from our community.blacksky.* API which is going on hold". So, my best guess is that his answer to you reflected the architecture (where the ommunity.blacksky,* API server is conceptually part of blacksky,.community) rather than the currently-available public implementation at the time.

        (And no idea whether he's standing up an early implementation of their Rust appview or doing the off-the-shelf Bluesky appview or something else.)

        mcc@mastodon.socialM 1 Reply Last reply
        0
        • jdp23@neuromatch.socialJ jdp23@neuromatch.social

          @mcc mmmmkay it looks like Rudy is now in the process of "standing up an app.bsky.* API server" (aka appview) which "Is different from our community.blacksky.* API which is going on hold". So, my best guess is that his answer to you reflected the architecture (where the ommunity.blacksky,* API server is conceptually part of blacksky,.community) rather than the currently-available public implementation at the time.

          (And no idea whether he's standing up an early implementation of their Rust appview or doing the off-the-shelf Bluesky appview or something else.)

          mcc@mastodon.socialM This user is from outside of this forum
          mcc@mastodon.socialM This user is from outside of this forum
          mcc@mastodon.social
          wrote on last edited by
          #167

          @jdp23 What's interesting to me here is, the bluesky line is "ha ha it's super good everyone is angry at us because it accelerates federation", but you're making it sound like Rudy is having to upend his software engineering schedule to do stuff he otherwise wouldn't have had to do at all early, because of this incident forcing him to protect his users

          by_caballero@mastodon.socialB 1 Reply Last reply
          0
          • eniko@mastodon.gamedev.placeE eniko@mastodon.gamedev.place

            @mcc what exactly is the benefit of migrating to a non bluesky PDS? I understand being on an entirely different vertical stack like Blacksky or Northsky but what does being on a PDS give you? Aren't you still (almost) entirely at bluesky's mercy?

            adrienne@social.treehouse.systemsA This user is from outside of this forum
            adrienne@social.treehouse.systemsA This user is from outside of this forum
            adrienne@social.treehouse.systems
            wrote on last edited by
            #168

            @eniko @mcc if you're on your own PDS, you at least don't lose all your existing posts if bsky decides to permaban you. (If you're on one of their mushroom PDSes, they'll nuke all your content along with a permaban.)

            anna@hexile.witches.liveA 1 Reply Last reply
            0
            • adrienne@social.treehouse.systemsA adrienne@social.treehouse.systems

              @eniko @mcc if you're on your own PDS, you at least don't lose all your existing posts if bsky decides to permaban you. (If you're on one of their mushroom PDSes, they'll nuke all your content along with a permaban.)

              anna@hexile.witches.liveA This user is from outside of this forum
              anna@hexile.witches.liveA This user is from outside of this forum
              anna@hexile.witches.live
              wrote on last edited by
              #169
              @adrienne @eniko @mcc one thing i was never clear on, if you have your own pds and get permad, can you migrate and get around the perma, or is it some kind of cryptographic seed/hash of your pds data that's perma'd so you're fucked?
              thisismissem@hachyderm.ioT 1 Reply Last reply
              0
              • mcc@mastodon.socialM mcc@mastodon.social

                @jdp23 What's interesting to me here is, the bluesky line is "ha ha it's super good everyone is angry at us because it accelerates federation", but you're making it sound like Rudy is having to upend his software engineering schedule to do stuff he otherwise wouldn't have had to do at all early, because of this incident forcing him to protect his users

                by_caballero@mastodon.socialB This user is from outside of this forum
                by_caballero@mastodon.socialB This user is from outside of this forum
                by_caballero@mastodon.social
                wrote on last edited by
                #170

                @mcc @jdp23 here guys this might help clarify why Rudy has to rearrange his epics in jira:
                https://whtwnd.com/bnewbold.net/3m2j6ccx2bs2t
                moderation can only be additive until/unless you pony up the CSAM/hashmatch API key money plus roll and run yr own mod sys at scale. thats the real Achilles heel of composable moderation-- replacing the bottom layer is incredibly expensive

                1 Reply Last reply
                0
                • anna@hexile.witches.liveA anna@hexile.witches.live
                  @adrienne @eniko @mcc one thing i was never clear on, if you have your own pds and get permad, can you migrate and get around the perma, or is it some kind of cryptographic seed/hash of your pds data that's perma'd so you're fucked?
                  thisismissem@hachyderm.ioT This user is from outside of this forum
                  thisismissem@hachyderm.ioT This user is from outside of this forum
                  thisismissem@hachyderm.io
                  wrote on last edited by
                  #171

                  @anna @adrienne @eniko @mcc all the records in your PDS contain references to your identity (DID document), it's theoretically possible to modify the data to change that but requires rewriting your entire PDS for that account, so not particularly practical.

                  It's the DID that is moderated against in the higher layers, not your handle.

                  So it doesn't matter if you're @fred.example or @jason.example, if the DID used for one becomes the DID used for another handle.

                  It's kinda like how on ActivityPub, software has often encoded your username into the identifier for all your posts, meaning you can't change it without breaking everything.

                  (Though Mastodon is starting to fix this long-standing issue, there's fix only applies on new accounts, there's no protocol level way to fix it yet — it's kinda a weakness in JSON-LD)

                  1 Reply Last reply
                  0
                  • mcc@mastodon.socialM mcc@mastodon.social

                    So. The thread above. An update.

                    We finally got a live test of the "Gertrude scenario", when a popular Blacksky user got permbanned by Bluesky. I, using my own PDS and blacksky's website, can't see him or his posts ( https://blacksky.community/profile/did:plc:2aebn3xk5t63net43eeepire/post/3m2iokicegs2b ). What gives?

                    A lot of people claim this is because Blacksky really is using Bluesky's appview, and gave me a way to verify this looking at headers. This seems to contradict Rudy's previous claims. I've asked Rudy for clarification: https://bsky.app/profile/did:plc:2aebn3xk5t63net43eeepire/post/3m2jve23cf22m

                    mcc@mastodon.socialM This user is from outside of this forum
                    mcc@mastodon.socialM This user is from outside of this forum
                    mcc@mastodon.social
                    wrote last edited by
                    #172

                    Follow up, 2025-12-27: Rudy here confirms the Blacksky appview is still being worked on (eg: blacksky uses bluesky's appview still)

                    Link Preview Image
                    Rudy wants revolution. (@rude1.blacksky.team)

                    Funding for Cash comes from CCI and the Cypherpunk Fellowship ($70K total). I am still working on the app-view. I hit storage limits on the previous server during backfill and needed to buy a $14K OVH Cloud instance.

                    favicon

                    Bluesky Social (bsky.app)

                    The sticking point, as he describes it, is "backfill". This alludes to the issue that makes me compare ATProto to blockchain: to get the features users expect, every node on the network must mirror the network's entire history. This is impractical, which is why bluesky is as of this moment a federated network with effectively only one node.

                    emaytch@mastodon.socialE whitequark@mastodon.socialW 2 Replies Last reply
                    0
                    • mcc@mastodon.socialM mcc@mastodon.social

                      Follow up, 2025-12-27: Rudy here confirms the Blacksky appview is still being worked on (eg: blacksky uses bluesky's appview still)

                      Link Preview Image
                      Rudy wants revolution. (@rude1.blacksky.team)

                      Funding for Cash comes from CCI and the Cypherpunk Fellowship ($70K total). I am still working on the app-view. I hit storage limits on the previous server during backfill and needed to buy a $14K OVH Cloud instance.

                      favicon

                      Bluesky Social (bsky.app)

                      The sticking point, as he describes it, is "backfill". This alludes to the issue that makes me compare ATProto to blockchain: to get the features users expect, every node on the network must mirror the network's entire history. This is impractical, which is why bluesky is as of this moment a federated network with effectively only one node.

                      emaytch@mastodon.socialE This user is from outside of this forum
                      emaytch@mastodon.socialE This user is from outside of this forum
                      emaytch@mastodon.social
                      wrote last edited by
                      #173

                      @mcc its really weird for it to be controversial to compare ATProto to blockchain when it was an explicit selling point of the protocol before blockchains became embarrassing to develop for!!

                      1 Reply Last reply
                      0
                      • mcc@mastodon.socialM mcc@mastodon.social

                        Follow up, 2025-12-27: Rudy here confirms the Blacksky appview is still being worked on (eg: blacksky uses bluesky's appview still)

                        Link Preview Image
                        Rudy wants revolution. (@rude1.blacksky.team)

                        Funding for Cash comes from CCI and the Cypherpunk Fellowship ($70K total). I am still working on the app-view. I hit storage limits on the previous server during backfill and needed to buy a $14K OVH Cloud instance.

                        favicon

                        Bluesky Social (bsky.app)

                        The sticking point, as he describes it, is "backfill". This alludes to the issue that makes me compare ATProto to blockchain: to get the features users expect, every node on the network must mirror the network's entire history. This is impractical, which is why bluesky is as of this moment a federated network with effectively only one node.

                        whitequark@mastodon.socialW This user is from outside of this forum
                        whitequark@mastodon.socialW This user is from outside of this forum
                        whitequark@mastodon.social
                        wrote last edited by
                        #174

                        @mcc it's such a confusing aspect of the protocol. why does everything need the firehose? how do they expect it to scale/?

                        mcc@mastodon.socialM 1 Reply Last reply
                        0
                        • whitequark@mastodon.socialW whitequark@mastodon.social

                          @mcc it's such a confusing aspect of the protocol. why does everything need the firehose? how do they expect it to scale/?

                          mcc@mastodon.socialM This user is from outside of this forum
                          mcc@mastodon.socialM This user is from outside of this forum
                          mcc@mastodon.social
                          wrote last edited by
                          #175

                          @whitequark If hypothetically, just hypothetically, we imagine that a core design requirement of the protocol was "regardless of what happens in future, it must continue to be necessary that the company Bluesky LLC exists"… the decision becomes a lot less confusing.

                          mcc@mastodon.socialM 1 Reply Last reply
                          0
                          • mcc@mastodon.socialM mcc@mastodon.social

                            @whitequark If hypothetically, just hypothetically, we imagine that a core design requirement of the protocol was "regardless of what happens in future, it must continue to be necessary that the company Bluesky LLC exists"… the decision becomes a lot less confusing.

                            mcc@mastodon.socialM This user is from outside of this forum
                            mcc@mastodon.socialM This user is from outside of this forum
                            mcc@mastodon.social
                            wrote last edited by
                            #176

                            @whitequark (More charitably: If one considered fast, full-text search to be a highest priority feature, and it was merely *unimportant* to the designer whether a second full-service node could ever function… then one might make the decisions bluesky made here.

                            As for scaling, I assume when the day comes they need it to actually scale they'll either discontinue or break the externally-published linear event stream?)

                            1 Reply Last reply
                            0
                            Reply
                            • Reply as topic
                            Log in to reply
                            • Oldest to Newest
                            • Newest to Oldest
                            • Most Votes


                            • Login

                            • Don't have an account? Register

                            • Login or register to search.
                            Powered by NodeBB Contributors
                            • First post
                              Last post
                            0
                            • Categories
                            • Recent
                            • Tags
                            • Popular
                            • World
                            • Users
                            • Groups