Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
We Distribute
  1. Home
  2. Technical Discussion
  3. I would like to give an update on "federation" on Bluesky.

I would like to give an update on "federation" on Bluesky.

Scheduled Pinned Locked Moved Technical Discussion
171 Posts 49 Posters 4.6k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • eblu@activitypub.spaceE This user is from outside of this forum
    eblu@activitypub.spaceE This user is from outside of this forum
    eblu@activitypub.space
    wrote last edited by
    #49

    On the flipside however, the fediverse deals with its own moderation problems. Some "too big to defederate" instance is left untouched for long enough for someone to slip in and post CSAM and suddenly it's everyone else's problem because there isn't any way to coordinate cross-server moderation decisions, and don't get me started on the amount of times that entire communities have been cut off and split apart over an admin/moderator deciding that they don't like the actions of a few individuals. It's part of why I don't feel comfortable self hosting in all honesty

    1 Reply Last reply
    2
    • mcc@mastodon.socialM mcc@mastodon.social

      I (me, mcc) never trusted Bluesky, so I've been self-hosting my own PDS from the start. I've been happily using blacksky.community for the last month (since Bluesky started gating access to their appview/web frontend on clicking to agree to a new TOS that seemed to me sketchy). Hypothetically, "Gertrude" could do the same. She can join Northsky PDS, make posts through Zeppelin, and Bluesky blocks her but Blacksky just fetches the posts from her PDS for me, and I get to read them.

      Right? (2/3)

      fabrice@fosstodon.orgF This user is from outside of this forum
      fabrice@fosstodon.orgF This user is from outside of this forum
      fabrice@fosstodon.org
      wrote last edited by
      #50

      @mcc Which PDS implementation are you self hosting with?

      mcc@mastodon.socialM 1 Reply Last reply
      0
      • mcc@mastodon.socialM mcc@mastodon.social

        I would like to give an update on "federation" on Bluesky.

        My expectation was it was unlikely we'd ever see this happen because "federation" on ATProto means basically reproducing the entirety of the Bluesky software stack. In old Big Data terms, on ActivityPub your instance is a "horizontal shard" of the network; ATProto forces full DB replicas only.

        Still, we're seeing movement on this front, which I'd split into two categories:

        1. Your fault (you reading this)
        2. Aaron Rodericks's fault

        M This user is from outside of this forum
        M This user is from outside of this forum
        mnordhoff@infosec.exchange
        wrote last edited by
        #51

        @mcc There's also https://plc.directory/, the did:plc: database, also run by Bluesky.

        ("plc" stands for "placeholder", because they aspire to figure out something blockchain decentralized later.)

        I think Bluesky can inconvenience people at best, or hijack their accounts at worst, especially if they were using a Bluesky PDS and Bluesky has all the keys. But I don't know/remember the exact implications.

        mcc@mastodon.socialM 1 Reply Last reply
        0
        • E esoteric_programmer@social.stealthy.club

          @alter_kaker @mcc hmm, apparently not that much knowledge is required, and the cost dropped significantly, I still don't trust any of it though

          Link Preview Image
          A Full-Network Relay for $34 a Month | bryan newbold (🇪🇺Europa again)

          This is an update to a Summer 2024 blog post. At the time, atproto relays required a cache of the full network on local disk to validate data structures. With the Sync v1.1 updates, relays don't need all that disk I/O. What impact does that have on hosting setup and operating costs? Turns out the d...

          favicon

          (whtwnd.com)

          lrhodes@merveilles.townL This user is from outside of this forum
          lrhodes@merveilles.townL This user is from outside of this forum
          lrhodes@merveilles.town
          wrote last edited by
          #52

          @esoteric_programmer @alter_kaker @mcc This is curious to me, because it looks like he's running a relay as an actual relay, just passing along data, which would explain why it's relatively low-cost. But the Relay described by the Bluesky white paper was more than just a relay— it was a replacement (or rebrand) for the earlier Big Data Server that was supposed to not only pass data, but also store and index it all for the network. And I can't tell if those other, more expensive functions got offloaded to other services, or if there are two types of relays in the infrastructure, or something else.

          mat@friendica.exon.nameM 1 Reply Last reply
          0
          • mcc@mastodon.socialM mcc@mastodon.social

            If you sign up with https://blacksky.community you get:

            - Blacksky's "appview"/web frontend
            - Optionally, Blacksky's PDS
            - Blacksky's moderation layer (and you can optionally enable Bluesky's too)

            Almost-complete independence! What I'm not clear on is to whether, or to what degree Blacksky relies on Bluesky's "relay":

            ahimsa_pdx@disabled.socialA This user is from outside of this forum
            ahimsa_pdx@disabled.socialA This user is from outside of this forum
            ahimsa_pdx@disabled.social
            wrote last edited by
            #53

            @mcc (if this is too off topic just ignore!)

            I noticed that Blacksky asks for a birth date when you make a new account.

            Bluesky didn't use to ask. No idea what they do now, but I would not have made an account with them if they required a birth date.

            I'm sure people make up dates but I was still surprised. I'm guessing this is related to age verification laws? I don't know much about them.

            Have any Fediverse servers started to ask for a birth date when a new account is created?

            mcc@mastodon.socialM 1 Reply Last reply
            0
            • fabrice@fosstodon.orgF fabrice@fosstodon.org

              @mcc Which PDS implementation are you self hosting with?

              mcc@mastodon.socialM This user is from outside of this forum
              mcc@mastodon.socialM This user is from outside of this forum
              mcc@mastodon.social
              wrote last edited by
              #54

              @fabrice the official one. It seems fine.

              Is there a reason to pick another?

              fabrice@fosstodon.orgF 1 Reply Last reply
              0
              • mcc@mastodon.socialM mcc@mastodon.social

                @fabrice the official one. It seems fine.

                Is there a reason to pick another?

                fabrice@fosstodon.orgF This user is from outside of this forum
                fabrice@fosstodon.orgF This user is from outside of this forum
                fabrice@fosstodon.org
                wrote last edited by
                #55

                @mcc I don't know 🙂 Maybe the Rust one from blacksky is less resource intensive?

                mcc@mastodon.socialM 1 Reply Last reply
                0
                • mcc@mastodon.socialM mcc@mastodon.social

                  The biggest movement on this front has come from the community formerly known as Black Twitter, which now has complete, viable alternative dupes of the whole stack:

                  Link Preview Image
                  Rudy wants revolution. (@rude1.blacksky.team)

                  blacksky.app → pds atproto.africa → relay blacksky.community → app @blackskyweb.xyz → moderation @tektite.cc → migration assembly.blacksky.community → governance blackskyweb.xyz → marketing website rsky.satnav.dev → exported data explorer https://blacksky.community

                  favicon

                  Blacksky Community (blacksky.community)

                  This makes intuitive sense to me! My first question, looking at ATP, is "why do free dev for this protocol, controlled by one corporation, when Fediverse is right there and is more complete?". But the black dev community, from everything I saw, tried to adopt Fediverse *first* and basically got harassed off.

                  nullpotential@fedia.socialN This user is from outside of this forum
                  nullpotential@fedia.socialN This user is from outside of this forum
                  nullpotential@fedia.social
                  wrote last edited by
                  #56

                  @mcc "tried to adopt Fediverse first and basically got harassed off."

                  what does this mean, exactly? you don't have to interact with any other instance on the whole stack if you don't want to. what I'm guessing is this actually means people tried to signup for mastodon.social which is a shithole and then that got conflated with the whole fediverse

                  ikuturso@mastodon.socialI 1 Reply Last reply
                  0
                  • ahimsa_pdx@disabled.socialA ahimsa_pdx@disabled.social

                    @mcc (if this is too off topic just ignore!)

                    I noticed that Blacksky asks for a birth date when you make a new account.

                    Bluesky didn't use to ask. No idea what they do now, but I would not have made an account with them if they required a birth date.

                    I'm sure people make up dates but I was still surprised. I'm guessing this is related to age verification laws? I don't know much about them.

                    Have any Fediverse servers started to ask for a birth date when a new account is created?

                    mcc@mastodon.socialM This user is from outside of this forum
                    mcc@mastodon.socialM This user is from outside of this forum
                    mcc@mastodon.social
                    wrote last edited by
                    #57

                    @ahimsa_pdx I don't know. I didn't make an account, apparently.

                    1 Reply Last reply
                    0
                    • M mnordhoff@infosec.exchange

                      @mcc There's also https://plc.directory/, the did:plc: database, also run by Bluesky.

                      ("plc" stands for "placeholder", because they aspire to figure out something blockchain decentralized later.)

                      I think Bluesky can inconvenience people at best, or hijack their accounts at worst, especially if they were using a Bluesky PDS and Bluesky has all the keys. But I don't know/remember the exact implications.

                      mcc@mastodon.socialM This user is from outside of this forum
                      mcc@mastodon.socialM This user is from outside of this forum
                      mcc@mastodon.social
                      wrote last edited by
                      #58

                      @mnordhoff yes, the plc is another really frustrating thing

                      1 Reply Last reply
                      0
                      • fabrice@fosstodon.orgF fabrice@fosstodon.org

                        @mcc I don't know 🙂 Maybe the Rust one from blacksky is less resource intensive?

                        mcc@mastodon.socialM This user is from outside of this forum
                        mcc@mastodon.socialM This user is from outside of this forum
                        mcc@mastodon.social
                        wrote last edited by
                        #59

                        @fabrice yeah, I dunno. I haven't noticed a load problem from the typescript implementation. I don't have a very data oriented operation over here tho

                        1 Reply Last reply
                        0
                        • mcc@mastodon.socialM mcc@mastodon.social

                          And that's why I say, TLDR:

                          - I am legitimately excited about the work being done by Blacksky Algorithms! I am using their frontend and happy with it.

                          - Northsky is an interesting development to watch

                          - If you're on a Bluesky PDS, I recommend migrating off with one of these tools https://bsky.app/profile/did:plc:ii5jchdzlmcojjw4dqczcgkh/post/3lyt6t6qfa22u

                          - Everything Sucks. A LOT of things would have to change at a social level for *any* entity other than Bluesky to have power or independence in the ATP ecosystem. I still don't trust Bluesky.

                          mcc@mastodon.socialM This user is from outside of this forum
                          mcc@mastodon.socialM This user is from outside of this forum
                          mcc@mastodon.social
                          wrote last edited by
                          #60

                          As an update since posting the above thread I have received replies from two people, one saying I am underestimating the level of stack coverage Blacksky has, another saying I am overestimating it.

                          The stack is just so tall! There are *so many* layers in this protocol's model. And it seems like every single one of them is an opportunity to introduce censorship

                          mcc@mastodon.socialM 1 Reply Last reply
                          0
                          • mcc@mastodon.socialM mcc@mastodon.social

                            I would like to give an update on "federation" on Bluesky.

                            My expectation was it was unlikely we'd ever see this happen because "federation" on ATProto means basically reproducing the entirety of the Bluesky software stack. In old Big Data terms, on ActivityPub your instance is a "horizontal shard" of the network; ATProto forces full DB replicas only.

                            Still, we're seeing movement on this front, which I'd split into two categories:

                            1. Your fault (you reading this)
                            2. Aaron Rodericks's fault

                            ozamidas@mastodon.socialO This user is from outside of this forum
                            ozamidas@mastodon.socialO This user is from outside of this forum
                            ozamidas@mastodon.social
                            wrote last edited by
                            #61

                            @mcc Look, Bluesky has some nice advantages over the fediverse, mainly that it's not confusing at all because it gets to the point of just being old Twitter.

                            Federation is not their strong point and will never be, whether we like it or not, if you want federation and multiple communities, Activitypub is by far the best option.

                            1 Reply Last reply
                            0
                            • bhasic@mastodon.socialB bhasic@mastodon.social

                              @benroyce @swetland @mcc @aeva

                              mastodonmigration@mastodon.onlineM This user is from outside of this forum
                              mastodonmigration@mastodon.onlineM This user is from outside of this forum
                              mastodonmigration@mastodon.online
                              wrote last edited by
                              #62

                              @bhasic @benroyce @swetland @mcc @aeva

                              Yup. And get very defensive about defending the charlatan.

                              1 Reply Last reply
                              0
                              • alter_kaker@hachyderm.ioA alter_kaker@hachyderm.io

                                @esoteric_programmer so this is all within my ability. But what about the rest of the stack? To my understanding, the PDS and view? As @mcc says things have to change in a social level but the first step is more nodes...

                                mat@friendica.exon.nameM This user is from outside of this forum
                                mat@friendica.exon.nameM This user is from outside of this forum
                                mat@friendica.exon.name
                                wrote last edited by
                                #63
                                @mcc @alter_kaker @esoteric_programmer I think the key point is: "Every Bluesky replica is, probably without realizing it, making a bet that Bluesky has already plateaued." This is a worthwhile experiment, as long as you can pull the plug at a moment's notice and lose nothing.
                                1 Reply Last reply
                                0
                                • lrhodes@merveilles.townL lrhodes@merveilles.town

                                  @esoteric_programmer @alter_kaker @mcc This is curious to me, because it looks like he's running a relay as an actual relay, just passing along data, which would explain why it's relatively low-cost. But the Relay described by the Bluesky white paper was more than just a relay— it was a replacement (or rebrand) for the earlier Big Data Server that was supposed to not only pass data, but also store and index it all for the network. And I can't tell if those other, more expensive functions got offloaded to other services, or if there are two types of relays in the infrastructure, or something else.

                                  mat@friendica.exon.nameM This user is from outside of this forum
                                  mat@friendica.exon.nameM This user is from outside of this forum
                                  mat@friendica.exon.name
                                  wrote last edited by
                                  #64
                                  @lrhodes @mcc @alter_kaker @esoteric_programmer My understanding is that relays have a "replay since timestamp X" functionality, so that consumers that go down for a while can get back up and running. Originally relays by definition had to support any X back to the beginning of time, leading to absurd storage costs. Today they are allowed to have a much shorter window, meaning in effect the storage cost is insignificant and it's the network cost that dominates. Unless I'm mistaken, the canonical store of a user's posting history is and always was the PDS.
                                  lrhodes@merveilles.townL 1 Reply Last reply
                                  0
                                  • mcc@mastodon.socialM mcc@mastodon.social

                                    @alter_kaker I'm not the person to ask. I would join the Bluesky API Touchers discord (yes, it's really named that) and ask there.

                                    Blacksky has all their software on GitHub (they are using a mix of original Bluesky software and their own stuff) but not instructions on how to deploy it as a whole stack.

                                    mat@friendica.exon.nameM This user is from outside of this forum
                                    mat@friendica.exon.nameM This user is from outside of this forum
                                    mat@friendica.exon.name
                                    wrote last edited by
                                    #65

                                    @mcc @alter_kaker "I would join the Bluesky API Touchers discord"

                                    But... why are they not using... no OK never mind.

                                    I'm so glad for this thread! I've had a bazillion questions about AT but nowhere to ask them. I really think there should be an "other protocols" channel on activitypub.space though. This is not "Technical discussion about ActivityPub-related topics" and sooner or later someone's gonna get angry at us.

                                    julian@activitypub.spaceJ thisismissem@hachyderm.ioT 2 Replies Last reply
                                    0
                                    • E esoteric_programmer@social.stealthy.club

                                      @alter_kaker @mcc hmm, apparently not that much knowledge is required, and the cost dropped significantly, I still don't trust any of it though

                                      Link Preview Image
                                      A Full-Network Relay for $34 a Month | bryan newbold (🇪🇺Europa again)

                                      This is an update to a Summer 2024 blog post. At the time, atproto relays required a cache of the full network on local disk to validate data structures. With the Sync v1.1 updates, relays don't need all that disk I/O. What impact does that have on hosting setup and operating costs? Turns out the d...

                                      favicon

                                      (whtwnd.com)

                                      ikuturso@mastodon.socialI This user is from outside of this forum
                                      ikuturso@mastodon.socialI This user is from outside of this forum
                                      ikuturso@mastodon.social
                                      wrote last edited by
                                      #66

                                      @esoteric_programmer @alter_kaker @mcc as I understand it the cost of a relay has gone down because you can run it without keeping full account of the message history for all time and instead restrict what you have to a time-window.

                                      Raises the question of whether that's good enough if we want real alternatives to the official company infra though.

                                      trwnh@mastodon.socialT 1 Reply Last reply
                                      0
                                      • mcc@mastodon.socialM mcc@mastodon.social

                                        And that's why I say, TLDR:

                                        - I am legitimately excited about the work being done by Blacksky Algorithms! I am using their frontend and happy with it.

                                        - Northsky is an interesting development to watch

                                        - If you're on a Bluesky PDS, I recommend migrating off with one of these tools https://bsky.app/profile/did:plc:ii5jchdzlmcojjw4dqczcgkh/post/3lyt6t6qfa22u

                                        - Everything Sucks. A LOT of things would have to change at a social level for *any* entity other than Bluesky to have power or independence in the ATP ecosystem. I still don't trust Bluesky.

                                        eniko@mastodon.gamedev.placeE This user is from outside of this forum
                                        eniko@mastodon.gamedev.placeE This user is from outside of this forum
                                        eniko@mastodon.gamedev.place
                                        wrote last edited by
                                        #67

                                        @mcc what exactly is the benefit of migrating to a non bluesky PDS? I understand being on an entirely different vertical stack like Blacksky or Northsky but what does being on a PDS give you? Aren't you still (almost) entirely at bluesky's mercy?

                                        carcosa@functional.cafeC mcc@mastodon.socialM adrienne@social.treehouse.systemsA 3 Replies Last reply
                                        0
                                        • jrose@social.belkadan.comJ jrose@social.belkadan.com

                                          @mcc For my own understanding: while the server architecture is different, the same thing could happen on the Fediverse, right? (Except portability is worse.) The only thing saving it is that mastodon.social is only the plurality of users, maybe a majority, but not the overwhelming majority?

                                          ikuturso@mastodon.socialI This user is from outside of this forum
                                          ikuturso@mastodon.socialI This user is from outside of this forum
                                          ikuturso@mastodon.social
                                          wrote last edited by
                                          #68

                                          @jrose @mcc Even the portability being better is somewhat theoretical right now because if your identity is using did:plc then you are unable to move away from did:plc and Bluesky PBC has custody of your keys... And also like people have noticed hosting your own data in a PDS does not really make you independent from their actions so the point of doing it is somewhat unclear.

                                          trwnh@mastodon.socialT 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups