Literally no one despises anti vaxxers more than I do, but to be fair, I’m not sure that refusing the Covid shot makes you one of them.
On second thought though, it can be a red flag. Like those people who say “I’m not a racist.....” then start using slurs. Maybe you are right, I guess.