The Prince of Wales did not travel to the Olympics in Paris this summer because he feared bringing a Covid infection home to his wife during her chemotherapy, he had said.