He denied stealing money from the company.
Correct (also: denied having stolen)
The prisoner begged allowed another phone call.
begged to be allowed
He gave up making excuses and apologized.
Correct