The main issue with summer tires below 40F is if the tire gets flexed below this temperature. This is tire temp not air temp. If temp was 20F and you left your 60F garage, the tires would drive ok and likely stay warm from driving. But, if you parked the car outside at 20F and then drive to work, the sidewall rubber has a better chance of cracking as it is not made for this. If you store tire below 40F it is likely ok as long as you do not inflate or deflate the tire while it is below 40F. If warmed to above 40F then cracking not as likely.
Yes grip is reduced at cooler temps but the big issue below 40F (tire temp) is cracking from rubber flex.
For Fed if the morning temp happens to be below 40F, just wait till it warms up. Then drive.
Sleep in or drive the golf cart around.