Figuring out which Fediverse servers to block is actually quite simple. All you need to do is ask yourself a couple of questions:

1. Have you ever had a positive interaction with that server?
2. Do you think it's likely that you'll have any positive interactions with that server in the future?

If your answer to both questions is "No," then it's probably a good idea to consider blocking it.