Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
We Distribute
  1. Home
  2. Technical Discussion
  3. I have deeply mixed feelings about #ActivityPub's adoption of JSON-LD, as someone who's spent way too long dealing with it while building #Fedify.

I have deeply mixed feelings about #ActivityPub's adoption of JSON-LD, as someone who's spent way too long dealing with it while building #Fedify.

Scheduled Pinned Locked Moved Technical Discussion
fedifyjsonldfedidevactivitypub
168 Posts 35 Posters 268 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • douginamug@mastodon.xyzD This user is from outside of this forum
    douginamug@mastodon.xyzD This user is from outside of this forum
    douginamug@mastodon.xyz
    wrote last edited by
    #2

    @hongminhee thank you for doing hard work with the plumbing! You are helping build coherence in this place and I'm grateful for it. Diverse people, unified standards 🖤

    hongminhee@hollo.socialH 1 Reply Last reply
    1
    • douginamug@mastodon.xyzD douginamug@mastodon.xyz

      @hongminhee thank you for doing hard work with the plumbing! You are helping build coherence in this place and I'm grateful for it. Diverse people, unified standards 🖤

      hongminhee@hollo.socialH This user is from outside of this forum
      hongminhee@hollo.socialH This user is from outside of this forum
      hongminhee@hollo.social
      wrote last edited by
      #3

      @douginamug@mastodon.xyz Thank you so much for recognizing my hard work!

      1 Reply Last reply
      0
      • hazelnoot@enby.lifeH This user is from outside of this forum
        hazelnoot@enby.lifeH This user is from outside of this forum
        hazelnoot@enby.life
        wrote last edited by
        #4

        @hongminhee@hollo.social boosting this for the excellent points, even though I'm one of the people not using JSON-LD and frequently producing malformed documents.

        (And honestly, I don't think I'll change that soon. Sharkey only uses JSON-LD on one single code path, and even that's been enough to introduce critical bugs. I'm planning to remove the JSON-LD lib entirely from Campfire fork.)

        ((And that's not even getting into the security problems with every JSON-LD lib I've ever audited...))

        1 Reply Last reply
        0
        • rimu@piefed.socialR This user is from outside of this forum
          rimu@piefed.socialR This user is from outside of this forum
          rimu@piefed.social
          wrote last edited by
          #5

          JSON-LD is a trap. Sorry you fell in.

          bumblefudge@activitypub.spaceB 2 Replies Last reply
          1
          • silverpill@mitra.socialS This user is from outside of this forum
            silverpill@mitra.socialS This user is from outside of this forum
            silverpill@mitra.social
            wrote last edited by
            #6

            @hongminhee

            >There's no going back.

            We absolutely must go back. Either we have a vibrant ecosystem where building stuff is a pleasant experience, or fediverse slowly dies while linked data cultists harass developers about nonresolvable URLs in @context.

            JSON-LD adds nothing to ActivityPub, it only creates problems. Time to move on.

            mariusor@metalhead.clubM 1 Reply Last reply
            0
            • rimu@piefed.socialR rimu@piefed.social

              JSON-LD is a trap. Sorry you fell in.

              bumblefudge@activitypub.spaceB This user is from outside of this forum
              bumblefudge@activitypub.spaceB This user is from outside of this forum
              bumblefudge@activitypub.space
              wrote last edited by
              #7

              > @hongminhee@hollo.social said in I have deeply mixed feelings about #ActivityPub's adoption of JSON-LD, as someone who's spent way too long dealing with it while building #Fedify.:
              >
              > Every time I get one of these bug reports, I feel a certain injustice. Like being the only person in the group project who actually read the assignment.

              This asymmetry of blame and credit is a real problem in distributed systems generally, as much economically as emotionally. The system doesn't actually scale to multiple disjoint platforms and orthogonal ecosystems without someone doing the hard work of open-world translation... if everyone hardcodes their preferred JSON shape it quickly becomes a zero-sum game and small players have to do much more work than big players. This has consistently been a challenge for public-benefit funders, who try funding load-bearing infrastructure like fedify to avoid those dynamics, but that often demands funding bigger teams on longer horizons than they are set up to fund by their structure.

              1 Reply Last reply
              0
              • rimu@piefed.socialR rimu@piefed.social

                JSON-LD is a trap. Sorry you fell in.

                bumblefudge@activitypub.spaceB This user is from outside of this forum
                bumblefudge@activitypub.spaceB This user is from outside of this forum
                bumblefudge@activitypub.space
                wrote last edited by
                #8

                @rimu@piefed.social we if it's a trap we're all in it because ActivityPub is a JSON-LD serialization fullstop, if the collective action problem results in a majority of projects wanting to abandon that and hardcode to a closed-world JSON model just fork the protocol and call it something else.

                1 Reply Last reply
                0
                • silverpill@mitra.socialS silverpill@mitra.social

                  @hongminhee

                  >There's no going back.

                  We absolutely must go back. Either we have a vibrant ecosystem where building stuff is a pleasant experience, or fediverse slowly dies while linked data cultists harass developers about nonresolvable URLs in @context.

                  JSON-LD adds nothing to ActivityPub, it only creates problems. Time to move on.

                  mariusor@metalhead.clubM This user is from outside of this forum
                  mariusor@metalhead.clubM This user is from outside of this forum
                  mariusor@metalhead.club
                  wrote last edited by
                  #9

                  > while linked data cultists harass developers about nonresolvable URLs

                  @silverpill I don't consider myself a cultist but I still think that putting invalid URLs in any payload where they are supposed to be meaningful is disrespectful towards anyone that consumes your API. Please don't do that.

                  @hongminhee

                  silverpill@mitra.socialS 1 Reply Last reply
                  0
                  • julian@activitypub.spaceJ This user is from outside of this forum
                    julian@activitypub.spaceJ This user is from outside of this forum
                    julian@activitypub.space
                    wrote last edited by julian@activitypub.space
                    #10

                    @hongminhee@hollo.social I'll give you my take on this... which is that my understanding of JSON-LD is that with JSON-LD you can have two disparate apps using the same property, like thread, and avoid namespace collision because one is actually https://example.org/ns/thread and the other's really https://foobar.com/ns/thread.

                    Great.

                    I posit that this is a premature optimization, and one that fails because of inadequate adoption. There are likely documented cases of implementations using the same property, and those concern the actual ActivityStreams vocabulary, and the solution to that is to communicate and work together so that you don't step on each others' toes.

                    I personally feel that it is a technical solution to a problem that can be completely handled by simply talking to one another... but we're coders, we're famously anti-social yes? mmmmm...

                    1 Reply Last reply
                    2
                    • benpate@mastodon.socialB This user is from outside of this forum
                      benpate@mastodon.socialB This user is from outside of this forum
                      benpate@mastodon.social
                      wrote last edited by
                      #11

                      @hongminhee

                      Great piece of writing, and I agree with lots of what you say here. Building this stuff is super hard, so good for you doing it “the right way.”

                      I hate not being able to trust the data I receive.

                      I’m one of those who’s taking the shortcuts, which has plenty of drawbacks, so I’m glad you’re in here fighting the good fight.

                      mariusor@metalhead.clubM 1 Reply Last reply
                      0
                      • benpate@mastodon.socialB benpate@mastodon.social

                        @hongminhee

                        Great piece of writing, and I agree with lots of what you say here. Building this stuff is super hard, so good for you doing it “the right way.”

                        I hate not being able to trust the data I receive.

                        I’m one of those who’s taking the shortcuts, which has plenty of drawbacks, so I’m glad you’re in here fighting the good fight.

                        mariusor@metalhead.clubM This user is from outside of this forum
                        mariusor@metalhead.clubM This user is from outside of this forum
                        mariusor@metalhead.club
                        wrote last edited by
                        #12

                        @benpate reminder that you can have a trusty library that fulfills more or less the same functionality of fedify any time you want to switch. ;;)

                        @hongminhee

                        1 Reply Last reply
                        1
                        • mat@friendica.exon.nameM This user is from outside of this forum
                          mat@friendica.exon.nameM This user is from outside of this forum
                          mat@friendica.exon.name
                          wrote last edited by
                          #13

                          @hongminhee @julian I'm a true believer in RDF from back in the day, so I'm hardly neutral. But...

                          There are essentially no interesting ActivityPub extensions right now. Even Evan's chess example, no-one's actually using AP to play chess. It's just ActivityStreams + a few cute tricks now and then. Even if there were extensions, existing AP servers chop off and throw away data they don't understand. so none of these extensions could work.

                          I feel like most of the "WTF am I learning JSON-LD for" criticisms are coming from this status quo. That includes "if someone wants to add a gallery thing or whatever, can't they make a FEP?" The way things work now, your extension either a) works only in your software or b) has to be painfully negotiated with the whole community. We're all gonna have a big fight about it on this forum anyway. Let's not pretend JSON-LD helps us.

                          But if we add two things to the mix, the situation looks different. Those are 1. server software that "keeps all the bits", and 2. a whitelabel extensible app. That would make it very easy to spin up crazy new experiences for a sizeable existing userbase. Developers should not be forced to endure a FEP process, and they should not have to attract a userbase from nothing. They should be able to just build, without even worrying if they're stepping on toes. And of course, Fedify and libraries in other languages are a load-bearing part of that world, including enforcement of the JSON-LD rules.

                          That world does not exist at all today, but JSON-LD does, so it's pretty valid to describe this design as premature optimisation. I dunno though, we don't seem that far away.

                          julian@activitypub.spaceJ 1 Reply Last reply
                          1
                          • mariusor@metalhead.clubM This user is from outside of this forum
                            mariusor@metalhead.clubM This user is from outside of this forum
                            mariusor@metalhead.club
                            wrote last edited by
                            #14

                            @julian I don't think it's premature optimization, but an artefact of ActivityPub being built on top of the Activity Streams vocabulary, which predates it by some time.

                            @hongminhee

                            1 Reply Last reply
                            1
                            • mat@friendica.exon.nameM mat@friendica.exon.name

                              @hongminhee @julian I'm a true believer in RDF from back in the day, so I'm hardly neutral. But...

                              There are essentially no interesting ActivityPub extensions right now. Even Evan's chess example, no-one's actually using AP to play chess. It's just ActivityStreams + a few cute tricks now and then. Even if there were extensions, existing AP servers chop off and throw away data they don't understand. so none of these extensions could work.

                              I feel like most of the "WTF am I learning JSON-LD for" criticisms are coming from this status quo. That includes "if someone wants to add a gallery thing or whatever, can't they make a FEP?" The way things work now, your extension either a) works only in your software or b) has to be painfully negotiated with the whole community. We're all gonna have a big fight about it on this forum anyway. Let's not pretend JSON-LD helps us.

                              But if we add two things to the mix, the situation looks different. Those are 1. server software that "keeps all the bits", and 2. a whitelabel extensible app. That would make it very easy to spin up crazy new experiences for a sizeable existing userbase. Developers should not be forced to endure a FEP process, and they should not have to attract a userbase from nothing. They should be able to just build, without even worrying if they're stepping on toes. And of course, Fedify and libraries in other languages are a load-bearing part of that world, including enforcement of the JSON-LD rules.

                              That world does not exist at all today, but JSON-LD does, so it's pretty valid to describe this design as premature optimisation. I dunno though, we don't seem that far away.

                              julian@activitypub.spaceJ This user is from outside of this forum
                              julian@activitypub.spaceJ This user is from outside of this forum
                              julian@activitypub.space
                              wrote last edited by
                              #15

                              @mat@friendica.exon.name that's a really interesting point of view, and has some parallels to how app development on the ATProto side is easier in many ways.

                              I do think that this is something C2S (aka the ActivityPub API) can enable.

                              I am critical of JSON-LD but I do certainly recognize I could be very wrong 😁

                              1 Reply Last reply
                              1
                              • sl007@digitalcourage.socialS This user is from outside of this forum
                                sl007@digitalcourage.socialS This user is from outside of this forum
                                sl007@digitalcourage.social
                                wrote last edited by
                                #16

                                @julian @mat

                                Do you know about the backgrounds of the immers project ?
                                , "no-one's actually using AP to play chess"
                                the reason that we have noa AP chess service _anymore_ is #uspol …

                                This all feels very unfair somehow cause I know the backgrounds but anyway …
                                While we 2 days ago had a long thread about our use of Chess Games I will link the video from the thread https://digitalcourage.social/@sl007/116023149133783002

                                immers with its federated locations and positional audio etc was supernice for playing chess !
                                Our use is fairly similar and straightforward like we did the chess Social CG meeting in 2018 and the rc3 (usually 18.000 people physically but here it was virtually cause pandemics) https://socialhub.activitypub.rocks/t/rc3-chaos-communication-congress/1202

                                Maybe it would really be fair if people are new to look into the 20 years Social CG history where some volunteers really gave much work 🙂
                                🧵 1/2

                                sl007@digitalcourage.socialS 1 Reply Last reply
                                0
                                • mat@friendica.exon.nameM This user is from outside of this forum
                                  mat@friendica.exon.nameM This user is from outside of this forum
                                  mat@friendica.exon.name
                                  wrote last edited by
                                  #17
                                  @julian I don't know as much as I'd like about AT Lexicons. That is, not so much how they work, but what the grand idea is? I don't even understand if Bluesky imagines them being mixed and matched JSON-LD style. I think not?
                                  liaizon@social.wake.stL 1 Reply Last reply
                                  0
                                  • sl007@digitalcourage.socialS sl007@digitalcourage.social

                                    @julian @mat

                                    Do you know about the backgrounds of the immers project ?
                                    , "no-one's actually using AP to play chess"
                                    the reason that we have noa AP chess service _anymore_ is #uspol …

                                    This all feels very unfair somehow cause I know the backgrounds but anyway …
                                    While we 2 days ago had a long thread about our use of Chess Games I will link the video from the thread https://digitalcourage.social/@sl007/116023149133783002

                                    immers with its federated locations and positional audio etc was supernice for playing chess !
                                    Our use is fairly similar and straightforward like we did the chess Social CG meeting in 2018 and the rc3 (usually 18.000 people physically but here it was virtually cause pandemics) https://socialhub.activitypub.rocks/t/rc3-chaos-communication-congress/1202

                                    Maybe it would really be fair if people are new to look into the 20 years Social CG history where some volunteers really gave much work 🙂
                                    🧵 1/2

                                    sl007@digitalcourage.socialS This user is from outside of this forum
                                    sl007@digitalcourage.socialS This user is from outside of this forum
                                    sl007@digitalcourage.social
                                    wrote last edited by
                                    #18

                                    @julian @mat

                                    We implemented this standard and you can create / describe your rooms [Place, `redaktor:fictional`] and the chessboard is just a geohash as described in the geosocial CG so the use is the same, just `redaktor:fictional` too,
                                    You load the Collection of Chessfigures (pawn1 ...) can name them, they `Travel` over the chessboard ant the `Arrive` describes the `result`.
                                    As always you can get very detailed with wikidata properties and entities but bare AS Vocabulary is enough.
                                    In the end you have a Collection for the Travels which is your played game which you can replay or do whatever with.

                                    But you can still install immers - it is worth a try https://github.com/immers-space

                                    The reason for its end are the same as for the gup.pe groups and I hope people konw about it …

                                    mat@friendica.exon.nameM 1 Reply Last reply
                                    0
                                    • mariusor@metalhead.clubM mariusor@metalhead.club

                                      > while linked data cultists harass developers about nonresolvable URLs

                                      @silverpill I don't consider myself a cultist but I still think that putting invalid URLs in any payload where they are supposed to be meaningful is disrespectful towards anyone that consumes your API. Please don't do that.

                                      @hongminhee

                                      silverpill@mitra.socialS This user is from outside of this forum
                                      silverpill@mitra.socialS This user is from outside of this forum
                                      silverpill@mitra.social
                                      wrote last edited by
                                      #19

                                      @mariusor @hongminhee The @context is not supposed to be required in the first place, but here we are adding it to every activity and wasting bandwidth because Mastodon developers didn't read the spec.

                                      mariusor@metalhead.clubM 1 Reply Last reply
                                      0
                                      • sl007@digitalcourage.socialS sl007@digitalcourage.social

                                        @julian @mat

                                        We implemented this standard and you can create / describe your rooms [Place, `redaktor:fictional`] and the chessboard is just a geohash as described in the geosocial CG so the use is the same, just `redaktor:fictional` too,
                                        You load the Collection of Chessfigures (pawn1 ...) can name them, they `Travel` over the chessboard ant the `Arrive` describes the `result`.
                                        As always you can get very detailed with wikidata properties and entities but bare AS Vocabulary is enough.
                                        In the end you have a Collection for the Travels which is your played game which you can replay or do whatever with.

                                        But you can still install immers - it is worth a try https://github.com/immers-space

                                        The reason for its end are the same as for the gup.pe groups and I hope people konw about it …

                                        mat@friendica.exon.nameM This user is from outside of this forum
                                        mat@friendica.exon.nameM This user is from outside of this forum
                                        mat@friendica.exon.name
                                        wrote last edited by
                                        #20

                                        @sl007 @julian I admit I didn't pay attention to immers at the time - I don't play games, not even chess. I was just using chess as an example, didn't mean to trigger anyone's trauma!

                                        Still, it kinda proves my point. You have to use standard AS vocabulary because Mastodon, and if you squint then sure, Travel and Arrive, why not? But given some of the conversations I've seen on this forum, I shudder to think how that would go down if you tried to get approval for that usage from "the community" first.

                                        sl007@digitalcourage.socialS 2 Replies Last reply
                                        0
                                        • mat@friendica.exon.nameM mat@friendica.exon.name

                                          @sl007 @julian I admit I didn't pay attention to immers at the time - I don't play games, not even chess. I was just using chess as an example, didn't mean to trigger anyone's trauma!

                                          Still, it kinda proves my point. You have to use standard AS vocabulary because Mastodon, and if you squint then sure, Travel and Arrive, why not? But given some of the conversations I've seen on this forum, I shudder to think how that would go down if you tried to get approval for that usage from "the community" first.

                                          sl007@digitalcourage.socialS This user is from outside of this forum
                                          sl007@digitalcourage.socialS This user is from outside of this forum
                                          sl007@digitalcourage.social
                                          wrote last edited by
                                          #21

                                          @mat Has a reason, just wrote it to @julian in a DM, just didn't want to post public.

                                          Not sure if you visited the link. This _was_ the community approval …
                                          Immers was famous and we had some official Social CG meetings where I linked one where thousands of community people attended (?)
                                          The W3C Social CG _is_ the Community (?)
                                          Meanwhile even Public Spaces Incubator uses it which is to my best knowledge the largest upcoming iimplementor by far.
                                          I mean apart from that it is pretty obvious after the meeting where we talked about "factual" vs "fictional".
                                          mastodon has nothing to do with this. The majority of projects count in a democracy. We had a demo playing chess between 4 softwares.

                                          Doing the official AP Conf and becoming elected Policy Lead, I had always asked the community. For 20 years 😞
                                          https://conf.tube/c/apconf_channel/videos

                                          Not sure if anyone did read the "Conformance Section" of ActivityPub. https://www.w3.org/TR/activitypub/#conformance
                                          It is section 2 - You have to support "The Entirety"...
                                          If mastodon does not it is not ActivityPub.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups