As those monuments were placed in public space so as to perpetuate prejudice and glorify white supremacy, they should be taken down.
If however you remove references to the confederacy and it's leaders from civil war battle sites like Gettysburg, Antietam and Manassas, I believe that is censoring history.