Nah, it's more likely the total power:weight impact vs "remove x lbs for y reduction in ET" weaker/slower vehicle or not.
To put it one way, take 100 lbs off of a Lotus Elise is very different than taking 100 lbs off of a Tesla Model X.
Taken to the Nth degree: Think about a transport truck hauling two full tandem trailers weighing what... 110,000 total lbs (?) In that case, you've got a 2800 lb engine producing just 450 or so horsepower and 1500 ft lbs revving out to 2000 RPMs. Fully loaded it'll do 0-60 in about 4 minutes, hauling around 45,000 lbs it'll do 0-60 in 2 minutes, and no trailer at about 20,000 lbs it can do it in 17-20 seconds.
Any improvement from weight reduction in quarter mile performance has got to be a percentage of total weight reduced vs the power available across the rev range (or total area under the curve, or whatever).