Why are my cats so anti-social and weird?

Cats can be more unsociable then other cats, its just they way they are, 1 of my cats is like that, he can get annoyed when i stroke him some times, and swipe for me with his paws, for no reason, but other times he can be so soft and sweet. Where as my other cat is really soft all the time, its just the way they are, but with yours coming from a rescue shelter, then they might have been abused or neglected when they were young, and they probably remember it, so that's why their acting strange. Theres not alot you can do about it really, just try and gain their trust a bit more. Well done for rescuing the cats by the way, i think its a lovely thing to do!