Don't worry about it. It happens more often than you think to many parents. Kids are more resilient than we expect. It's an honest mistake. My wife and I also freak out when it happened... welcome to parenthood.
Now, this may sound like I'M a horrible father, but there have been instance...