"So I think we should remember him as a great philosopher, but a pretty shitty guy."

In a world where Kings were chosen by God, where a whole people can be described as chosen by God, why on earth would you have to be a "shitty guy" to believe that racial differences were ordained by God and made visible so that we could act on them? So, yes, we should "just say" that Kant was a relic of the past, as someday we will be. May no one ever say of your obsolete opinions "Yes, it was THAT bad."