Block accounts from your following list on Threads. Blocking also unfollows and removes them, and they won't be able to find or refollow you.
