The former cabinet minister says the Labour leader still has the “2019 manifesto round his neck”.