I usually go around 9-10 AM to my pool. The kids (and college kids) as well as most of the work a day world is off someplace else. I can usually get a lane. And it's daylight. I think the most important point is - find some kind of movement you enjoy & do it. Obviously, you can't relax & enjoy swimming in this particular pool. I wish you all the best in your search. Don't give up if it's something you love. :)