Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
We Distribute
  1. Home
  2. Technical Discussion
  3. I would like to give an update on "federation" on Bluesky.

I would like to give an update on "federation" on Bluesky.

Scheduled Pinned Locked Moved Technical Discussion
171 Posts 49 Posters 4.6k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • mcc@mastodon.socialM mcc@mastodon.social

    I (me, mcc) never trusted Bluesky, so I've been self-hosting my own PDS from the start. I've been happily using blacksky.community for the last month (since Bluesky started gating access to their appview/web frontend on clicking to agree to a new TOS that seemed to me sketchy). Hypothetically, "Gertrude" could do the same. She can join Northsky PDS, make posts through Zeppelin, and Bluesky blocks her but Blacksky just fetches the posts from her PDS for me, and I get to read them.

    Right? (2/3)

    fabrice@fosstodon.orgF This user is from outside of this forum
    fabrice@fosstodon.orgF This user is from outside of this forum
    fabrice@fosstodon.org
    wrote last edited by
    #50

    @mcc Which PDS implementation are you self hosting with?

    mcc@mastodon.socialM 1 Reply Last reply
    0
    • mcc@mastodon.socialM mcc@mastodon.social

      I would like to give an update on "federation" on Bluesky.

      My expectation was it was unlikely we'd ever see this happen because "federation" on ATProto means basically reproducing the entirety of the Bluesky software stack. In old Big Data terms, on ActivityPub your instance is a "horizontal shard" of the network; ATProto forces full DB replicas only.

      Still, we're seeing movement on this front, which I'd split into two categories:

      1. Your fault (you reading this)
      2. Aaron Rodericks's fault

      M This user is from outside of this forum
      M This user is from outside of this forum
      mnordhoff@infosec.exchange
      wrote last edited by
      #51

      @mcc There's also https://plc.directory/, the did:plc: database, also run by Bluesky.

      ("plc" stands for "placeholder", because they aspire to figure out something blockchain decentralized later.)

      I think Bluesky can inconvenience people at best, or hijack their accounts at worst, especially if they were using a Bluesky PDS and Bluesky has all the keys. But I don't know/remember the exact implications.

      mcc@mastodon.socialM 1 Reply Last reply
      0
      • E esoteric_programmer@social.stealthy.club

        @alter_kaker @mcc hmm, apparently not that much knowledge is required, and the cost dropped significantly, I still don't trust any of it though

        Link Preview Image
        A Full-Network Relay for $34 a Month | bryan newbold (🇪🇺Europa again)

        This is an update to a Summer 2024 blog post. At the time, atproto relays required a cache of the full network on local disk to validate data structures. With the Sync v1.1 updates, relays don't need all that disk I/O. What impact does that have on hosting setup and operating costs? Turns out the d...

        favicon

        (whtwnd.com)

        lrhodes@merveilles.townL This user is from outside of this forum
        lrhodes@merveilles.townL This user is from outside of this forum
        lrhodes@merveilles.town
        wrote last edited by
        #52

        @esoteric_programmer @alter_kaker @mcc This is curious to me, because it looks like he's running a relay as an actual relay, just passing along data, which would explain why it's relatively low-cost. But the Relay described by the Bluesky white paper was more than just a relay— it was a replacement (or rebrand) for the earlier Big Data Server that was supposed to not only pass data, but also store and index it all for the network. And I can't tell if those other, more expensive functions got offloaded to other services, or if there are two types of relays in the infrastructure, or something else.

        mat@friendica.exon.nameM 1 Reply Last reply
        0
        • mcc@mastodon.socialM mcc@mastodon.social

          If you sign up with https://blacksky.community you get:

          - Blacksky's "appview"/web frontend
          - Optionally, Blacksky's PDS
          - Blacksky's moderation layer (and you can optionally enable Bluesky's too)

          Almost-complete independence! What I'm not clear on is to whether, or to what degree Blacksky relies on Bluesky's "relay":

          ahimsa_pdx@disabled.socialA This user is from outside of this forum
          ahimsa_pdx@disabled.socialA This user is from outside of this forum
          ahimsa_pdx@disabled.social
          wrote last edited by
          #53

          @mcc (if this is too off topic just ignore!)

          I noticed that Blacksky asks for a birth date when you make a new account.

          Bluesky didn't use to ask. No idea what they do now, but I would not have made an account with them if they required a birth date.

          I'm sure people make up dates but I was still surprised. I'm guessing this is related to age verification laws? I don't know much about them.

          Have any Fediverse servers started to ask for a birth date when a new account is created?

          mcc@mastodon.socialM 1 Reply Last reply
          0
          • fabrice@fosstodon.orgF fabrice@fosstodon.org

            @mcc Which PDS implementation are you self hosting with?

            mcc@mastodon.socialM This user is from outside of this forum
            mcc@mastodon.socialM This user is from outside of this forum
            mcc@mastodon.social
            wrote last edited by
            #54

            @fabrice the official one. It seems fine.

            Is there a reason to pick another?

            fabrice@fosstodon.orgF 1 Reply Last reply
            0
            • mcc@mastodon.socialM mcc@mastodon.social

              @fabrice the official one. It seems fine.

              Is there a reason to pick another?

              fabrice@fosstodon.orgF This user is from outside of this forum
              fabrice@fosstodon.orgF This user is from outside of this forum
              fabrice@fosstodon.org
              wrote last edited by
              #55

              @mcc I don't know 🙂 Maybe the Rust one from blacksky is less resource intensive?

              mcc@mastodon.socialM 1 Reply Last reply
              0
              • mcc@mastodon.socialM mcc@mastodon.social

                The biggest movement on this front has come from the community formerly known as Black Twitter, which now has complete, viable alternative dupes of the whole stack:

                Link Preview Image
                Rudy wants revolution. (@rude1.blacksky.team)

                blacksky.app → pds atproto.africa → relay blacksky.community → app @blackskyweb.xyz → moderation @tektite.cc → migration assembly.blacksky.community → governance blackskyweb.xyz → marketing website rsky.satnav.dev → exported data explorer https://blacksky.community

                favicon

                Blacksky Community (blacksky.community)

                This makes intuitive sense to me! My first question, looking at ATP, is "why do free dev for this protocol, controlled by one corporation, when Fediverse is right there and is more complete?". But the black dev community, from everything I saw, tried to adopt Fediverse *first* and basically got harassed off.

                nullpotential@fedia.socialN This user is from outside of this forum
                nullpotential@fedia.socialN This user is from outside of this forum
                nullpotential@fedia.social
                wrote last edited by
                #56

                @mcc "tried to adopt Fediverse first and basically got harassed off."

                what does this mean, exactly? you don't have to interact with any other instance on the whole stack if you don't want to. what I'm guessing is this actually means people tried to signup for mastodon.social which is a shithole and then that got conflated with the whole fediverse

                ikuturso@mastodon.socialI 1 Reply Last reply
                0
                • ahimsa_pdx@disabled.socialA ahimsa_pdx@disabled.social

                  @mcc (if this is too off topic just ignore!)

                  I noticed that Blacksky asks for a birth date when you make a new account.

                  Bluesky didn't use to ask. No idea what they do now, but I would not have made an account with them if they required a birth date.

                  I'm sure people make up dates but I was still surprised. I'm guessing this is related to age verification laws? I don't know much about them.

                  Have any Fediverse servers started to ask for a birth date when a new account is created?

                  mcc@mastodon.socialM This user is from outside of this forum
                  mcc@mastodon.socialM This user is from outside of this forum
                  mcc@mastodon.social
                  wrote last edited by
                  #57

                  @ahimsa_pdx I don't know. I didn't make an account, apparently.

                  1 Reply Last reply
                  0
                  • M mnordhoff@infosec.exchange

                    @mcc There's also https://plc.directory/, the did:plc: database, also run by Bluesky.

                    ("plc" stands for "placeholder", because they aspire to figure out something blockchain decentralized later.)

                    I think Bluesky can inconvenience people at best, or hijack their accounts at worst, especially if they were using a Bluesky PDS and Bluesky has all the keys. But I don't know/remember the exact implications.

                    mcc@mastodon.socialM This user is from outside of this forum
                    mcc@mastodon.socialM This user is from outside of this forum
                    mcc@mastodon.social
                    wrote last edited by
                    #58

                    @mnordhoff yes, the plc is another really frustrating thing

                    1 Reply Last reply
                    0
                    • fabrice@fosstodon.orgF fabrice@fosstodon.org

                      @mcc I don't know 🙂 Maybe the Rust one from blacksky is less resource intensive?

                      mcc@mastodon.socialM This user is from outside of this forum
                      mcc@mastodon.socialM This user is from outside of this forum
                      mcc@mastodon.social
                      wrote last edited by
                      #59

                      @fabrice yeah, I dunno. I haven't noticed a load problem from the typescript implementation. I don't have a very data oriented operation over here tho

                      1 Reply Last reply
                      0
                      • mcc@mastodon.socialM mcc@mastodon.social

                        And that's why I say, TLDR:

                        - I am legitimately excited about the work being done by Blacksky Algorithms! I am using their frontend and happy with it.

                        - Northsky is an interesting development to watch

                        - If you're on a Bluesky PDS, I recommend migrating off with one of these tools https://bsky.app/profile/did:plc:ii5jchdzlmcojjw4dqczcgkh/post/3lyt6t6qfa22u

                        - Everything Sucks. A LOT of things would have to change at a social level for *any* entity other than Bluesky to have power or independence in the ATP ecosystem. I still don't trust Bluesky.

                        mcc@mastodon.socialM This user is from outside of this forum
                        mcc@mastodon.socialM This user is from outside of this forum
                        mcc@mastodon.social
                        wrote last edited by
                        #60

                        As an update since posting the above thread I have received replies from two people, one saying I am underestimating the level of stack coverage Blacksky has, another saying I am overestimating it.

                        The stack is just so tall! There are *so many* layers in this protocol's model. And it seems like every single one of them is an opportunity to introduce censorship

                        mcc@mastodon.socialM 1 Reply Last reply
                        0
                        • mcc@mastodon.socialM mcc@mastodon.social

                          I would like to give an update on "federation" on Bluesky.

                          My expectation was it was unlikely we'd ever see this happen because "federation" on ATProto means basically reproducing the entirety of the Bluesky software stack. In old Big Data terms, on ActivityPub your instance is a "horizontal shard" of the network; ATProto forces full DB replicas only.

                          Still, we're seeing movement on this front, which I'd split into two categories:

                          1. Your fault (you reading this)
                          2. Aaron Rodericks's fault

                          ozamidas@mastodon.socialO This user is from outside of this forum
                          ozamidas@mastodon.socialO This user is from outside of this forum
                          ozamidas@mastodon.social
                          wrote last edited by
                          #61

                          @mcc Look, Bluesky has some nice advantages over the fediverse, mainly that it's not confusing at all because it gets to the point of just being old Twitter.

                          Federation is not their strong point and will never be, whether we like it or not, if you want federation and multiple communities, Activitypub is by far the best option.

                          1 Reply Last reply
                          0
                          • bhasic@mastodon.socialB bhasic@mastodon.social

                            @benroyce @swetland @mcc @aeva

                            mastodonmigration@mastodon.onlineM This user is from outside of this forum
                            mastodonmigration@mastodon.onlineM This user is from outside of this forum
                            mastodonmigration@mastodon.online
                            wrote last edited by
                            #62

                            @bhasic @benroyce @swetland @mcc @aeva

                            Yup. And get very defensive about defending the charlatan.

                            1 Reply Last reply
                            0
                            • alter_kaker@hachyderm.ioA alter_kaker@hachyderm.io

                              @esoteric_programmer so this is all within my ability. But what about the rest of the stack? To my understanding, the PDS and view? As @mcc says things have to change in a social level but the first step is more nodes...

                              mat@friendica.exon.nameM This user is from outside of this forum
                              mat@friendica.exon.nameM This user is from outside of this forum
                              mat@friendica.exon.name
                              wrote last edited by
                              #63
                              @mcc @alter_kaker @esoteric_programmer I think the key point is: "Every Bluesky replica is, probably without realizing it, making a bet that Bluesky has already plateaued." This is a worthwhile experiment, as long as you can pull the plug at a moment's notice and lose nothing.
                              1 Reply Last reply
                              0
                              • lrhodes@merveilles.townL lrhodes@merveilles.town

                                @esoteric_programmer @alter_kaker @mcc This is curious to me, because it looks like he's running a relay as an actual relay, just passing along data, which would explain why it's relatively low-cost. But the Relay described by the Bluesky white paper was more than just a relay— it was a replacement (or rebrand) for the earlier Big Data Server that was supposed to not only pass data, but also store and index it all for the network. And I can't tell if those other, more expensive functions got offloaded to other services, or if there are two types of relays in the infrastructure, or something else.

                                mat@friendica.exon.nameM This user is from outside of this forum
                                mat@friendica.exon.nameM This user is from outside of this forum
                                mat@friendica.exon.name
                                wrote last edited by
                                #64
                                @lrhodes @mcc @alter_kaker @esoteric_programmer My understanding is that relays have a "replay since timestamp X" functionality, so that consumers that go down for a while can get back up and running. Originally relays by definition had to support any X back to the beginning of time, leading to absurd storage costs. Today they are allowed to have a much shorter window, meaning in effect the storage cost is insignificant and it's the network cost that dominates. Unless I'm mistaken, the canonical store of a user's posting history is and always was the PDS.
                                lrhodes@merveilles.townL 1 Reply Last reply
                                0
                                • mcc@mastodon.socialM mcc@mastodon.social

                                  @alter_kaker I'm not the person to ask. I would join the Bluesky API Touchers discord (yes, it's really named that) and ask there.

                                  Blacksky has all their software on GitHub (they are using a mix of original Bluesky software and their own stuff) but not instructions on how to deploy it as a whole stack.

                                  mat@friendica.exon.nameM This user is from outside of this forum
                                  mat@friendica.exon.nameM This user is from outside of this forum
                                  mat@friendica.exon.name
                                  wrote last edited by
                                  #65

                                  @mcc @alter_kaker "I would join the Bluesky API Touchers discord"

                                  But... why are they not using... no OK never mind.

                                  I'm so glad for this thread! I've had a bazillion questions about AT but nowhere to ask them. I really think there should be an "other protocols" channel on activitypub.space though. This is not "Technical discussion about ActivityPub-related topics" and sooner or later someone's gonna get angry at us.

                                  julian@activitypub.spaceJ thisismissem@hachyderm.ioT 2 Replies Last reply
                                  0
                                  • E esoteric_programmer@social.stealthy.club

                                    @alter_kaker @mcc hmm, apparently not that much knowledge is required, and the cost dropped significantly, I still don't trust any of it though

                                    Link Preview Image
                                    A Full-Network Relay for $34 a Month | bryan newbold (🇪🇺Europa again)

                                    This is an update to a Summer 2024 blog post. At the time, atproto relays required a cache of the full network on local disk to validate data structures. With the Sync v1.1 updates, relays don't need all that disk I/O. What impact does that have on hosting setup and operating costs? Turns out the d...

                                    favicon

                                    (whtwnd.com)

                                    ikuturso@mastodon.socialI This user is from outside of this forum
                                    ikuturso@mastodon.socialI This user is from outside of this forum
                                    ikuturso@mastodon.social
                                    wrote last edited by
                                    #66

                                    @esoteric_programmer @alter_kaker @mcc as I understand it the cost of a relay has gone down because you can run it without keeping full account of the message history for all time and instead restrict what you have to a time-window.

                                    Raises the question of whether that's good enough if we want real alternatives to the official company infra though.

                                    trwnh@mastodon.socialT 1 Reply Last reply
                                    0
                                    • mcc@mastodon.socialM mcc@mastodon.social

                                      And that's why I say, TLDR:

                                      - I am legitimately excited about the work being done by Blacksky Algorithms! I am using their frontend and happy with it.

                                      - Northsky is an interesting development to watch

                                      - If you're on a Bluesky PDS, I recommend migrating off with one of these tools https://bsky.app/profile/did:plc:ii5jchdzlmcojjw4dqczcgkh/post/3lyt6t6qfa22u

                                      - Everything Sucks. A LOT of things would have to change at a social level for *any* entity other than Bluesky to have power or independence in the ATP ecosystem. I still don't trust Bluesky.

                                      eniko@mastodon.gamedev.placeE This user is from outside of this forum
                                      eniko@mastodon.gamedev.placeE This user is from outside of this forum
                                      eniko@mastodon.gamedev.place
                                      wrote last edited by
                                      #67

                                      @mcc what exactly is the benefit of migrating to a non bluesky PDS? I understand being on an entirely different vertical stack like Blacksky or Northsky but what does being on a PDS give you? Aren't you still (almost) entirely at bluesky's mercy?

                                      carcosa@functional.cafeC mcc@mastodon.socialM adrienne@social.treehouse.systemsA 3 Replies Last reply
                                      0
                                      • jrose@social.belkadan.comJ jrose@social.belkadan.com

                                        @mcc For my own understanding: while the server architecture is different, the same thing could happen on the Fediverse, right? (Except portability is worse.) The only thing saving it is that mastodon.social is only the plurality of users, maybe a majority, but not the overwhelming majority?

                                        ikuturso@mastodon.socialI This user is from outside of this forum
                                        ikuturso@mastodon.socialI This user is from outside of this forum
                                        ikuturso@mastodon.social
                                        wrote last edited by
                                        #68

                                        @jrose @mcc Even the portability being better is somewhat theoretical right now because if your identity is using did:plc then you are unable to move away from did:plc and Bluesky PBC has custody of your keys... And also like people have noticed hosting your own data in a PDS does not really make you independent from their actions so the point of doing it is somewhat unclear.

                                        trwnh@mastodon.socialT 1 Reply Last reply
                                        0
                                        • nullpotential@fedia.socialN nullpotential@fedia.social

                                          @mcc "tried to adopt Fediverse first and basically got harassed off."

                                          what does this mean, exactly? you don't have to interact with any other instance on the whole stack if you don't want to. what I'm guessing is this actually means people tried to signup for mastodon.social which is a shithole and then that got conflated with the whole fediverse

                                          ikuturso@mastodon.socialI This user is from outside of this forum
                                          ikuturso@mastodon.socialI This user is from outside of this forum
                                          ikuturso@mastodon.social
                                          wrote last edited by
                                          #69

                                          @nullpotential @mcc people on Bluesky who have soured on fedi often complain about having been lectured about using alt text and CWs for what it's worth.

                                          trwnh@mastodon.socialT 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups