Why cant i fly my confederate flag without you thinking im racist?

slavery was not an issue until late in the civil war. it was about the states rights and the north was pressuring the south with their ideas and beliefs. aint it quite ironic that the north sold slaves to the south but was trying to stop the south from having slaves?