The Labour politician went on to defend his controversial remarks which sparked an anti-Semitism row within the Labour Party.
He said: “The literal fact about all of this is that if you go on the Holocaust Memorial website in Jerusalem, I don’t think anyone’s going to accuse it of anything anti-Semitic, they’ve actually got a document about the agreement between Hitler and the Zionists in the 1930s.
“They acknowledged it was controversial and the Zionist leader who signed it was assassinated within a few weeks but I didn’t even criticise it, I just stated it was there as a fact.”
Ken Livingstone did not apologise for his remarks
The art of politics is to tell the truth
Dale ripped into Mr Livingstone and asked: “But the party clearly disagree with you, surely part of the art of politics is to know when to shut up.”
But the former Brent East MP disagreed and said an expulsion would not have been justified.
He said: “Well no, the art of politics is to tell the truth.
“I mean the only reason I wasn’t expelled yesterday, because the panel had been set up keen to do that, was I’m certain that when they went off to make their decision in private their barrister and their lawyer was saying ‘look if you expel Livingstone and it goes to judicial review, you haven’t got a chance’.
Jeremy Corbyn in pictures Tue, July 12, 2016
Labour Leader Jeremy Corbyn takes part in a community meeting at the Guru Har Rai Gurdwara Sahib temple
Reuters 1 of 36
Get Quotes on Home Insurance
Britain's opposition Labour Party leader Jeremy Corbyn speaks at an anti-racism rally in London
Jeremy Corbyn has launched a fresh investigation into Mr Livingstone
“What judge is going to say ‘you should discipline someone for telling the truth’.”
In a statement, Mr Corbyn said people were “understandably upset” by Mr Livingstone’s remarks.
He said: "It is deeply disappointing that, despite his long record of standing up to racism, Ken has failed to acknowledge or apologise for the hurt he has caused.
"Many people are understandably upset that he has continued to make offensive remarks which could open him to further disciplinary action.
"Since initiating the disciplinary process, I have not interfered with it and respect the independence of the party's disciplinary bodies.
"But Ken's subsequent comments and actions will now be considered by the National Executive Committee after representations from party members."