Your boyfriend and his Ex and a little vacation?!?!?!?!?

If I were you I would say no. It's not necessarily that you don't' trust him, but since they have a history together anything could happen while they are alone.