The founders did not want a state religion. They had no intention of removing any religion from the nation or prohibiting the free belief in whatever religion a person felt an affinity for.
There is no basis to believe that they would deny religious principles from elected officials or government institutions. That is a modern concept.