Should have
He regrets telling that lie.
He shouldn't have told that lie.
I regret having eaten so much last night.
I shouldn't have eaten so much last night.
She regrets not inviting her neighbors to the party.
She should have invited her neighbors to the party.