FediDB stopped crawling for a while to add support for robots.txt. The server drop-off is probably mostly because many are opting out of being crawled.

Nice!