I meant everyone who established Congress.

Congress didn't get established as it is by a slave owning south to the chagrin of the not-slave-owning-north.

Slavery was only ever (very rightfully) addressed far after.

That was the point I was making.