I hear that! I am the same way, which oftentimes pisses off my friends when they want to go somewhere.
Below is my list of places i will flat-out refuse to drive in.
Because of speed & rigged red-light cameras:
Frederick, MD
Howard County, MD
Montgomery County, MD
Downtown Laurel, MD
Most downtown parts of Baltimore City
Nazi-terrorist cops who pull you over for anything:
Charles Town, WV
Fredericksburg, VA
Harford County, MD
Skyline Drive, VA (pretty drive but 35 is a BS speed limit which ruins the drive entirely)
Ocean City, MD
If i absolutely must drive through these areas i'll drive like a grandma or have someone else drive their car.