The Literal Commandment
"You shall utterly destroy all the places where the nations whom you shall dispossess serve their gods, on the high mountains and on the hills and under every green tree. You shall tear down their altars and smash their sacred pillars and burn their Asherim with fire, and you shall cut down the engraved images of their gods and obliterate their name from that place. (Deuteronomy 12:2)
The literal commandment is that we should destroy idols and the items associated with them in "all the places where the nations whom you shall dispossess serve their gods". This commandment is specific to the Land of Israel.