The 46-year-old has steered the Reds to Qatar following a 4-0 win over Jamaica where he will be the only other English boss joining Gareth Southgate at the tournament.
It's a remarkable journey for Herdman, who like Jose Mourinho, is a former teacher before entering the professional game.
Herdman's innovative techniques while taking charge of PE at a school in his hometown of Consett, County Durham, spread around the region.
That led to him combining his work with part-time coaching at Sunderland where he not only worked with a very young Jordan Henderson but was also warned not to expect to mix it with the best.
He told the Newcastle Chronicle: "I had a great time at Sunderland; it was the Peter Reid era and there was a great group of people but I realised quickly that there was a mentality in England that if you hadn't played at the highest level you had no chance.
"This was before the Jose Mourinho or Rafa Benitez era, the guys who paved the way for the more academic coach.
"There wasn't much opportunity to work with anyone apart from youth players if, like me, you'd come through a different route.
"I will never forget there was an ex-England player, who was at the time in the England youth coaching system, and I was coaching his son at Sunderland.
"I'll never forget him. He stopped me and he said: 'Look John, you're a really good teacher-coach. I wish I had the teaching skill you had but the one thing you'll never have is that experience of standing in a field in front of 60,000 people.'
"And he said: 'That's why you'll never get to the highest level'.
"It's always stuck in the back of my mind. My God, I want to prove you wrong. I won't name names but it's always stuck with me."
Two decades ago, Herdman decided to accept an offer to work in New Zealand where he eventually was put in charge of their women's team.
Under his guidance, New Zealand's women were guided to the World Cup in 2007 and 2011 as well as the 2008 Olympics.
Herdman's road to success came from his desire to expand his coaching knowledge at every opportunity - from ex-All Black Lester Routledge to even spending time with Billy Beane discussing his Moneyball concept.
He told the Times: "I remember my wife saying, 'How you didn't die in those early years'.
"I was driving from Invercargill to Dunedin for high-performance coaching sessions which would be 3½ hours on a country road, it's Lord of the Rings country, travelling through Hobbiton, then drive back.
"A couple of times I fell asleep at the wheel. I rang Claire one night driving back and said, 'The sky's gone green, I think I'm seeing things. I must be losing my mind with fatigue'. She said, 'You're going to be all right - it's the Southern Lights.'"
Herdman took over as Canada men's boss in 2018 following a successful six-year reign in charge of the country's women team that included Olympic bronze medals at London 2012 and Rio 2016.
On the road to Qatar, Canada are currently top of their CONCACAF group ahead of the USA and Mexico with just one defeat in 13 games.
Herdman has successfully gelled the likes of Bayern Munich superstar Alphonso Davies and Arsenal target Jonathan David with less-heralded talents such as Reading's Junior Hoilett and German second tier star Scott Kennedy.
Speaking after their place was confirmed with a win over Jamaica, he said: "We just qualified for the World Cup, this is a legit football country.
"When I first took over and I said, 'We're going to qualify for the World Cup', I don't think they believed us.
"I'm happy for them because all of these fans have waited and waited and waited, and hung in with us - and we're going.
"I think this country never believed in us because we've given them nothing to believe in. They believe now.
"This is the time for everyone to get behind football and unite because we can be a powerhouse."
Canada will also be heavily tipped to better their last World Cup appearance at Mexico 1986, where they finished bottom without scoring.
And another impressive showing under Herdman's tutelage could help him fulfil his long-term ambition of returning to boyhood Newcastle.
He said: "Of course I'd harbour that dream of one day leading the club out at St James' Park to Local Hero. Which football manager born in the North East and not a Sunderland fan doesn't dream of that?
"It's always in the back of your mind but as a manager, you've just got to win your next game. That's all you think about! That's how we live and how we roll, unfortunately."
In the meantime, Herdman has more pressing concerns, adding to the Times: "(Let's) see if I can get Canada in at Wembley!
"I'm trying to see if I can get a friendly with Gareth Southgate."