The Three Lions boss was on the receiving off some loud boos at Molineux as his side fell to a poor 4-0 defeat against Hungary in the UEFA Nations League.
It was the team's heaviest home defeat since 1928.
As a result, England are sitting bottom of their group, with just two points in their four matches so far, Southgate's worst run since taking charge of England.
While this winter's World Cup in Qatar remains the country's primary goal, such a run of results in the Nations League certainly hasn't sat well.
Southgate has come in for criticism for what some perceive to be negative tactics, something that has been highlighted by the one solitary goal scored in their past four matches, a penalty from Harry Kane against Germany in Munich.
However, leaping to Southgate's defence is ex-Liverpool star Jamie Carragher who shared a gentle reminder of the manager's pedigree on Twitter.
He wrote: "'You don't know what you're doing', shut up you clowns.
"This manager has taken the country in two tournaments to the best positions since 1966."
Since taking over in 2016, Southgate guided the side to a World Cup semi-final two years later and the Euro 2020 final.
Croatia knocked England out in 2018, while Italy won on penalties at Wembley last year.
That includes an impressive record of 46 wins in 74 matches as England boss, including an impressive 158 goals scored and just 49 goals conceded.
Southgate was asked about the criticism from the crowd by talkSPORT's Faye Carruthers, and said it's the kind of thing that pushes a manager to their limits.
"It's not a pleasant experience," he said. "It's one that all of my predecessors have been through.
"But I've had some incredible nights with England, and this is the reality of football. You're going to have nights that are particularly painful and that might stretch you as a human being right to right to the limits, and tonight was one of those.
"It's amazing how quickly things can unravel in terms of support and feeling, but I've been in football for 30 years or more and this is the nature of football.
"I've seen it with England teams in the past and England managers in the past. It's emotional for everybody. I totally understand it and it's my responsibility in the end for the results."