It's a valid fear! I braved two hours of daily commuting on the NYC Subway, and that was with gestational diabetes, which can increase nausea and fatigue...
I think it depends on how much time has passed. If its' pretty recent, I think it does make it harder to move on, especially if you have secret hopes...