Yes, you can ask to be referred elsewhere, but it is worth thinking about the travel if you are feeling ill. Most consultants understand your fears and will do their best to help you.