Mr Burns has also had the Tory party whip removed following allegations of inappropriate behaviour.