"There never was any shame for you. The shame actually is ours," the British prime minister said.