Correct.Of course they will.
The POINT is that--if this is your assertion, then rights and what it is to be human in the first place are all subjective and depend on the whims of society.
Go on then. If that is your belief, then act on it. Start a political party based upon your belief. Hitler did quite well for a time, and still has adherents today. What stops his ideas from rising again is empowering decent people, educating rather than indoctrination, telling the truth and trusting people to be humane with each other. There will always be bigots who want to suppress Jews or people of colour or homosexuals or transgender people. Decent people will prevail if societies empower decency.That being the case, what is to stop us from turning your logic on you--and deciding that you are subhuman, and thus not subject to rights? Because--THAT is where your logic ultimately leads.