It would be the case if they implemented authenticated fetch, which is a fediverse protocol that mastodon and some others support, but it’s not widely enabled because anything that doesn’t support it would get blocked. It basically allows servers to reject fetches from defederated servers, and since lemmy doesn’t support it, defederation is somewhat one way since the defederated server can still anonymously fetch new content despite being defederated.