Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
We Distribute
  1. Home
  2. General Discussion
  3. With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts.

With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts.

Scheduled Pinned Locked Moved General Discussion
holosdiscovernobotnoindexactivitypub
16 Posts 10 Posters 1 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • apps@toot.fedilab.appA apps@toot.fedilab.app

    With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
    Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
    We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

    lexinova@cyberplace.socialL This user is from outside of this forum
    lexinova@cyberplace.socialL This user is from outside of this forum
    lexinova@cyberplace.social
    wrote last edited by
    #3

    @apps the issue of #nobot #noindex, it's the fact it's opt-out

    and people are fedup of opt out and want opt in

    apps@toot.fedilab.appA 1 Reply Last reply
    0
    • lexinova@cyberplace.socialL lexinova@cyberplace.social

      @apps the issue of #nobot #noindex, it's the fact it's opt-out

      and people are fedup of opt out and want opt in

      apps@toot.fedilab.appA This user is from outside of this forum
      apps@toot.fedilab.appA This user is from outside of this forum
      apps@toot.fedilab.app
      wrote last edited by
      #4

      @lexinova
      The debate goes beyond that. The real question is why developers chose to enable "indexable" by default when creating an account. A default opt-in is effectively an opt-out. That's where the conversation should start.

      lutindiscret@mastodon.libre-entreprise.comL 1 Reply Last reply
      0
      • apps@toot.fedilab.appA apps@toot.fedilab.app

        With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
        Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
        We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

        raphaelmorgan@disabled.socialR This user is from outside of this forum
        raphaelmorgan@disabled.socialR This user is from outside of this forum
        raphaelmorgan@disabled.social
        wrote last edited by
        #5

        @apps I see no problem with this approach 🤷 generally opt-in is better than opt-out, so if there's a way to make it opt-in even for people on servers that allow indexing by default that would probably decrease the backlash, but like... If we don't want our posts indexed, we can turn indexing off and it seems y'all were respecting that so I don't mind

        1 Reply Last reply
        0
        • apps@toot.fedilab.appA apps@toot.fedilab.app

          With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
          Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
          We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

          apps@toot.fedilab.appA This user is from outside of this forum
          apps@toot.fedilab.appA This user is from outside of this forum
          apps@toot.fedilab.app
          wrote last edited by
          #6

          We were caught off guard by the reactions and acted quickly. But we want to give the community a voice. We'll follow the result of this poll: if it should have stayed up, we'll reopen the source code and bring the service back.

          lexinova@cyberplace.socialL catsalad@infosec.exchangeC 2 Replies Last reply
          0
          • apps@toot.fedilab.appA apps@toot.fedilab.app

            With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
            Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
            We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

            lutindiscret@mastodon.libre-entreprise.comL This user is from outside of this forum
            lutindiscret@mastodon.libre-entreprise.comL This user is from outside of this forum
            lutindiscret@mastodon.libre-entreprise.com
            wrote last edited by
            #7

            @apps if an account is marked as indexable, just index it. If the default is wrong, that's the instance admin fault, nit yours.

            If Google can index it you can too.

            If people are unhappy with the setting of their profile, they can change it or blame the software or the admin and not people of good faith like you.

            Public toots are talking to the world in a megaphone by design, expecting privacy is absurd

            apps@toot.fedilab.appA 1 Reply Last reply
            0
            • apps@toot.fedilab.appA apps@toot.fedilab.app

              @lexinova
              The debate goes beyond that. The real question is why developers chose to enable "indexable" by default when creating an account. A default opt-in is effectively an opt-out. That's where the conversation should start.

              lutindiscret@mastodon.libre-entreprise.comL This user is from outside of this forum
              lutindiscret@mastodon.libre-entreprise.comL This user is from outside of this forum
              lutindiscret@mastodon.libre-entreprise.com
              wrote last edited by
              #8

              @apps this 100℅ the wrong people in being blamed here

              1 Reply Last reply
              0
              • lutindiscret@mastodon.libre-entreprise.comL lutindiscret@mastodon.libre-entreprise.com

                @apps if an account is marked as indexable, just index it. If the default is wrong, that's the instance admin fault, nit yours.

                If Google can index it you can too.

                If people are unhappy with the setting of their profile, they can change it or blame the software or the admin and not people of good faith like you.

                Public toots are talking to the world in a megaphone by design, expecting privacy is absurd

                apps@toot.fedilab.appA This user is from outside of this forum
                apps@toot.fedilab.appA This user is from outside of this forum
                apps@toot.fedilab.app
                wrote last edited by
                #9

                @lutindiscret
                We panicked quickly because things escalated beyond what we expected. But we still believe our approach was far more respectful than what's already happening: the same data is being exploited by others without users even knowing. At worst, we raised awareness.

                1 Reply Last reply
                0
                • apps@toot.fedilab.appA apps@toot.fedilab.app

                  With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
                  Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
                  We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

                  scriptfanix@maly.ioS This user is from outside of this forum
                  scriptfanix@maly.ioS This user is from outside of this forum
                  scriptfanix@maly.io
                  wrote last edited by
                  #10

                  @apps Tough one: I feel like you did set it up respectfully, so it should have stayed up. BUT taking it down when people voice concerns and objected was also the right thing to do, both morally and for the reputation of the Holos project.

                  1 Reply Last reply
                  0
                  • apps@toot.fedilab.appA apps@toot.fedilab.app

                    We were caught off guard by the reactions and acted quickly. But we want to give the community a voice. We'll follow the result of this poll: if it should have stayed up, we'll reopen the source code and bring the service back.

                    lexinova@cyberplace.socialL This user is from outside of this forum
                    lexinova@cyberplace.socialL This user is from outside of this forum
                    lexinova@cyberplace.social
                    wrote last edited by
                    #11

                    @apps maybe make a post for the most used (mastodon), on witch settings change for people that do not want to allow this.

                    As they may have missed this or misunderstood what the switch did

                    And since one of the two is recommemded, it may make them allow thing they actually don't want 🙂

                    some may misunderstand both settings:

                    - Include public posts in search results
                    - Feature profile and posts in discovery algorithms

                    apps@toot.fedilab.appA 1 Reply Last reply
                    0
                    • apps@toot.fedilab.appA apps@toot.fedilab.app

                      We were caught off guard by the reactions and acted quickly. But we want to give the community a voice. We'll follow the result of this poll: if it should have stayed up, we'll reopen the source code and bring the service back.

                      catsalad@infosec.exchangeC This user is from outside of this forum
                      catsalad@infosec.exchangeC This user is from outside of this forum
                      catsalad@infosec.exchange
                      wrote last edited by
                      #12

                      @apps Fediverse search engines are a contentious subject with a bad history, so I undestand you shutting it down.

                      While I'm fine with it, many people are very against things like that.

                      1 Reply Last reply
                      0
                      • apps@toot.fedilab.appA apps@toot.fedilab.app

                        With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
                        Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
                        We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

                        arthfach@social.arthfach.comA This user is from outside of this forum
                        arthfach@social.arthfach.comA This user is from outside of this forum
                        arthfach@social.arthfach.com
                        wrote last edited by
                        #13

                        @apps You did the right thing. You followed every consent option - both positive ("indexable" enabled, public posts) and negative (honoring bio tags, honoring locked accounts, honoring an opt-out signal).

                        There's not much, if anything, more you could realistically have done for what is to my understanding a fediverse search engine.

                        1 Reply Last reply
                        0
                        • apps@toot.fedilab.appA apps@toot.fedilab.app

                          With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
                          Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
                          We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

                          stomata@procial.tchncs.deS This user is from outside of this forum
                          stomata@procial.tchncs.deS This user is from outside of this forum
                          stomata@procial.tchncs.de
                          wrote last edited by
                          #14

                          @apps@toot.fedilab.app accidentally voted wrong. I think it should stay. Search on small instances suck.

                          1 Reply Last reply
                          0
                          • apps@toot.fedilab.appA apps@toot.fedilab.app

                            With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
                            Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
                            We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

                            tati@eldritch.cafeT This user is from outside of this forum
                            tati@eldritch.cafeT This user is from outside of this forum
                            tati@eldritch.cafe
                            wrote last edited by
                            #15

                            @apps the things that concerned me at the time were, in the initial announcement, 'we follow every signal' but only in this post did we know what signals you were following; and language of 'people may have misunderstood the defaults' which unfortunately rhymes with what less conscientious organisations say to justify hoovering all the things

                            if i had known the list of things you were looking at, i would have simply checked them and slept well. i didn't, so i blocked the bot, which now proves to have been unnecessary

                            1 Reply Last reply
                            0
                            • lexinova@cyberplace.socialL lexinova@cyberplace.social

                              @apps maybe make a post for the most used (mastodon), on witch settings change for people that do not want to allow this.

                              As they may have missed this or misunderstood what the switch did

                              And since one of the two is recommemded, it may make them allow thing they actually don't want 🙂

                              some may misunderstand both settings:

                              - Include public posts in search results
                              - Feature profile and posts in discovery algorithms

                              apps@toot.fedilab.appA This user is from outside of this forum
                              apps@toot.fedilab.appA This user is from outside of this forum
                              apps@toot.fedilab.app
                              wrote last edited by
                              #16

                              @lexinova
                              We can't change how Mastodon presents those settings, but we had a page explaining how the service works and how to opt out per platform. We'll communicate even more clearly if the service comes back.

                              Worth noting that this opt-in by default setting also allows Google to index fediverse profiles, except they don't check for consent at all. This is a much bigger issue that goes way beyond our project, which actually tries to do things the right way.

                              1 Reply Last reply
                              0
                              Reply
                              • Reply as topic
                              Log in to reply
                              • Oldest to Newest
                              • Newest to Oldest
                              • Most Votes


                              • Login

                              • Don't have an account? Register

                              • Login or register to search.
                              Powered by NodeBB Contributors
                              • First post
                                Last post
                              0
                              • Categories
                              • Recent
                              • Tags
                              • Popular
                              • World
                              • Users
                              • Groups