I was a skinny kid in school, but my older brother was a giant. I never feared the bullies when he was around.
There are an awful lot of European and South American nations with similarly small militaries compared to the US, yet none of them seem to be living in perpetual fear of being invaded either.