During an appearance on Loose Women today, the Strictly Come Dancing star, who got the boot on Tuesday, called out the How Clean Is Your House? host for bullying her co-stars.
The 38-year-old suggested Kim was only getting away with it because she was older, saying "she should know better".
When asked about her removal following a spat with Jamie O'Hara, James commented: "I still think she's not exactly the nicest lady in the world, but she knows she is on TV.
"I believe she does it at times she knows the cameras are on her, which is all the time pretty much. During nominations, during tasks… she ups her game. I think it is a big plan from the beginning."
Celebrity Big Brother 2017: James Jordan has slammed Kim Woodburn on Loose Women
Celebrity Big Brother 2017: James Jordan suggested Kim Woodburn was bulling her co stars
Celebrity Big Brother 2017 highlights
Tue, January 17, 2017
Celebrity Big Brother 2017: The best bits from the latest series including all the arguments, kisses and Tony the Pony.
1 of 14
Celebrity Big Brother viewers were surprised to hear Kim Woodburn urging Chloe Ferry to become an escort
Kim Woodburn's not exactly the nicest lady in the world, but she knows she is on TV!
James continued: "It is the way you deliver something, you can have an opinion and be opinionated, but she does it for no reason most of the time. She just attacks people.
"Then she has all these low blows, like saying to Jamie about committing adultery and leaving your three children. She doesn't know the true reasons behind all that - it is none of her business. Don't bring children or families into it."
When he was asked where the line was between banter and bullying, the dancer agreed with panelist Jennifer Ellison that 74-year-old Kim's behaviour could be defined as the latter.
Celebrity Big Brother 2017: Kim Woodburn was removed the house last night
Celebrity Big Brother 2017: James Jordan also said Calum Best acted like a baby
"I agree. I think Kim's getting away with it because she is an older lady. [She is saying] really hurtful, horrible things… She has gone in there for that reason," he said.
James, who is married to Strictly's Ola Jordan, added that Calum Best should have been happy when Coleen Nolan suggested he was one-night-stand material.
"He's got gentleman written across his knuckles to remind him… We had big arguments and they didn't air… When Coleen said he'd be her one-night stand he acted like a little baby. I'd take that as a compliment! I'll be your one-night stand," he went on.
Loose Women airs weekdays at 12.30pm on ITV, while Celebrity Big Brother continues tonight at 9pm.