There is a risk travellers could bring Covid variants back to the UK, a government adviser warns.