ofcom do seem to suggest I have the right to cancel and only pay for what I've used so far in the first 14 days
https://www.ofcom.org.uk/phones-and-broadband/switching-provider/switching-broadband-provider
Although I bet they will charge me £££s for the connection..