Since King Charles managed to not fit his youngest son, Prince Harry, into his schedule when he was in the U.K. in mid-May, he’s nervous about what the future holds. “Harry is heartbroken and worried he’ll never see his father again,” a source claimed. As OK! previously reported, Harry, 39, was back home to celebrate the 10th anniversary of the Invictus Games, but the King, who is currently battling cancer, had other events to attend to. “In response to the many inquiries and continued speculation on whether or not the duke will meet with his father while in the U.K. this week, it, unfortunate…