The 28-year-old comedian joined Tim Lovejoy, 49, after the host joked last week that his presenting partner was being replaced after he was suspended.
Viewers of the Channel 4 programme didn't seem impressed with Joe's appearance, however, taking to social media to complain.
"The persistently unfunny and extremely limited @joelycett on @SundayBrunchC4. Ah well…" one angry fan tweeted.
"Could Joe Lycett be any more dull?" another added, while a third slammed: "I wish I was half as funny as @joelycett thinks he is on #SundayBrunch."
Joe Lycett joined Sunday Brunch host Tim Lovejoy to co-host today's show
Sunday Brunch fans seemed less than impressed with Joe
Many took to Twitter to slam the stand-in host Sunday Brunch: Most talked about moments Fri, November 25, 2016
Sunday Brunch: Tim Lovejoy & Simon Rimmer's best bits and most talked about moments from the weekend show.
Channel 4 1 of 10
Sunday Brunch's most talked about moments
A fourth added: "Who is the plonker presenting on #SundayBrunch with Tim this morning? #sticktoyourdayjob."
Halfway through the show, Joe made a shock announcement when he declared he was “quitting".
Get Quotes on Home Insurance
The guests and hosts toasted to DJ Tim Westwood, 59, who would be appearing on the show next week, as the star raised a glass in a video clip, saying: "Cheers Tim, cheers Joe."
Looking delighted, Joe enthused: "Did I just get a name check from Tim Westwood?
Joe seemed stunned when DJ Tim Westwood name checked him
He jokingly announced that he was quitting there and then
"I'm quitting! I'm done!" he joked, holding his hands up in the air in surprise.
Not all the viewers were critical of the guest presenter, however, as many seemed pleased to see him on their screens.
"@joelycett is the perfect choice to co-present @SundayBrunchC4," one gushed, while another praised his presenting skills, saying: "Joe is one funny man. He reminds me of the late and great Frankie Howard. Great humour, fantastic camera work."
A third complimented the comedian, adding: "Omg Joe Lycett is on #SundayBrunch best part to my Sunday, he's hilarious."
Sunday Brunch continues next week at 9.30am on Channel 4.