Exactly so.
I used to build companies from scratch that employed thousands or tens of thousands of people by the time I moved on to the next. (And I couldn't have built them without the help of "evil" investment bankers/Wall Street/shareholders/pension funds/...).
One day I read YMOYL. I sold off my interests in my enterprises a few months later, and "retired" as suggested in YMOYL to reclaim the rest of my life for myself. That was 16+ years ago or so.
Now, I'm clearly not doing my "duty" to society as some envision it, because I'm not busting my ass 80+ hours a week building new technologies, creating new jobs, and so on. I'm not performing fully "according to my ability".
Luckily I already know how to dig ditches and plow fields, so I should be OK when they come to take me to the camps.