Ehiogu suffered a cardiac arrest at Tottenham’s training ground yesterday and died in the early hours of this morning.
Merson was a close friend of Ehiogu after playing with him at Aston Villa at the end of the 20th century and he paid tribute to the former defender.
“I’m still devastated,” Merson said on Sky Sports News.
“He was a man-mountain.
Ugo Ehiogu in pictures Fri, April 21, 2017
Former England defender Ugo Ehiogu has died after suffering a cardiac arrest
Play slideshow Getty Images 1 of 7
Ugo Ehiogu has died aged 44
He was a top player, top bloke and a good friend as well
Merson on Ehiogu
“Do you know what, Billy Joel always sings a song: ‘Only the good die young’.
“He was a top player, top bloke and a good friend as well.
“I spoked to him recently, he was always winding me up saying Tottenham have got some good players coming through.
“It goes out to his family and everything. It’s so hard.”
Paul Merson (right) was in tears as he paid tribute to Ugo Ehiogu
Ehiogu collapsed at Tottenham's training ground yesterday
Ehiogu, 44, was rushed to hospital yesterday after collapsing during a training session at Spurs' Enfield training complex.
The former defender played four times for England, scoring once.
He won the League Cup twice with Aston Villa in the 1990s and then again with Middlesbrough in 2004.
Tributes to Ehiogu have come pouring in this morning.
Ehiogu's former Villa team-mate Lee Hendrie told Sky Sports News: "To find out he has passed away, it must be devastating for his family.
"Ugo was such a character. He has always been that bubbly character. He was just a great guy to have around."
Ehiogu won the League Cup three times during his playing career
Ehiogu joined Middlesbrough in an £8m deal in 2000
Villa, for whom Ehiogu played more than 300 games, tweeted: "We are deeply saddened to hear of the death of our former defender Ugo Ehiogu.
"Our thoughts are with his family at this terribly sad time."
Ehiogu enjoyed a brief stint at Rangers, where he scored against Celtic in an Old Firm clash.
— Rangers FC (@RangersFC) April 21, 2017
Rangers said in a statement: "Rangers Football Club is shocked and saddened by the sudden passing of former defender Ugo Ehiogu.
"The 44-year-old Englishman joined the Light Blues when Walter Smith returned as manager in 2007 and made a huge impact in his short time in Glasgow – notably his winning goal at Celtic Park in the derby.
"He died after suffering a heart attack at Tottenham's training ground and everyone associated with the club sends their sincere condolences to Ugo's family and friends at this difficult time."