From a Buddhist perspective this is probably a correct view. From the standard human being perspective, especially one that has some power, military or political behind them, it is wishful thinking.
Throughout history, choose your continent, Antarctica exempted, military leaders, of one sort or another have always conquered, with little or no concern for the populace of the conquered. That does not make it right, it makes it common, to all human cultures, throughout all history.
The Indians, Cambodians, Vietnamese, Thais, Aztecs, Incas, and so forth, it is not merely a European habit. The fault is not the monsters, it is human nature, the pyramid of skulls more than a man's height, and yards long, for each side, was a Genghis Khan favorite, to stop people from resisting him.
It would also help, if you mentioned that there were more than 31 million Americans of whom only 400,000 were slave owners. barely over 1 percent of the population. Which is far better than had imagined.