Jermaine Simmons fled out of the house and hid behind a fence after he was caught sleeping with a husband's wife.
Benjamin Stephens caught the pair in his daughter's bedroom and screamed, "I'm going kill him" after he witnessed their illicit liaison.
The husband raced to the bedroom to grab his gun before chasing the pastor out of the house, who was forced to hide behind a fence/
Stephens' wife called the police when the husband began screaming as he threatened to drop Simmons clothes, wallet and car keys off at the church, before warning that he would expose the pastor online.
Jermaine Simmons apologised after he was caught having sex with a man's wife
What I want from God, I have already received – that’s his forgiveness
The husband came home early after his son's Florida school had asked if he could collect his child as his wife had failed to arrive.
Pastor Simmons received a huge amount of criticism after the incident but has vowed he will not quit the church he has been running since 2005.
After the incident the pastor posted an imagine on social media which read: "Don't let your problems paralyse your progress. Move forward.
The pastor has since given a speech at Jacob Chapel, in Tallahassee, where he was positively greeted by his congregation.
Jermaine Simmons was applauded by his congregation during his speech
Simmons, who is married with one son, said: "What I want from God, I have already received – that’s his forgiveness.
"What I am asking of our members is something that I may or may not get, and that is your prayers and your forgiveness.
"It hurts me that you have to defend my actions, because when you love somebody you wanna fight for them. You wanna defend them.
"But let me be very clear you cannot defend sin.
"You can't jump in the ocean. You cant survive with sharks out there – I'm talking about the internet."