Actually how does Lemmy and the Fediverse even work for search engines with regard to duplication? Do each instance only show posts from communities which are moderated on the instance, and dynamically show a robots.txt to ignore federated communities? Or since posts federate, does each instance a post federates to show up in search results? I could see the latter being really annoying to someone who doesn’t understand what’s going on, and keeps getting results for the same exact post, although would be nice to have a replacement for adding site:reddit.com to some search results.