I don't think a facepalm is always self directed, I think it's also commonly used to express disbelief at someone else. If yours was directed at yourself, who am I to decide otherwise? If it was directed elsewhere as a sort of "I can't believe anyone in their right mind would disagree with me", my befuddled state remains.