Not if enough folks think your posting there is a sign you're an ass.
If you hang out in a bar with KKK memorabilia everywhere - and open the replies of any reasonably popular news story on X before complaining that's not a fair comparison - people make conclusions off your presence, even if you're personally there for the tasty beer.
I have never seen KKK posts on X. Either you're commenting from personal experience, in which case, wow, who were you following, or you're going off reporting which would seem to be a bit skewed.
Those people would have long left X though so I'm not sure why the existing people would think that. If you're talking about external people judging them about posting there, no one thinks that, like the sibling comment mentions. People will just think at worst that they might need the reach of X so they begrudgingly post there.