The talkSPORT host, and The United Stand presenter, took aim at the supporters who are laying the blame on the manager following a shock 3-0 defeat to Bournemouth.
Ten Hag is under pressure following that defeat that leaves them sixth in the Premier League.
However, Goldbridge believes it is the players who must shoulder the responsibility of the poor result.
He told talkSPORT: "Listening to United fans saying this is Ten Hag's fault and saying bring Ole back, when did they start supporting United? Last week?
"Some of these players have been here through Mourinho, Ole and Rangnick and people are saying maybe Ten Hag is the problem. I can't believe it, it's like goldfish memory.
Read more on Man United
Man United weigh up move for out-of-favour Man City midfielder Kalvin Phillips
Stat shows how 'embarrassing' United have destroyed the Old Trafford fortress
"These players, who were leaking at the start of the week that Ten Hag had lost 50 per cent of the dressing room, Gabby was right saying that the players turned up thinking 'it's just Bournemouth'.
"I listened to Ten Hag's press conference and he said you have to be sharp, you've got to be on it every game. In this league this season everyone is killing everybody.
"He will have said that to his players. Ten Hag knew the threat of Bournemouth and knows how competitive this league is.
"Unfortunately, when a manager says that in a press conference it's verbal, it's evidential. He knew Bournemouth were a threat today, but for some reason the players went on the pitch cold and didn't deliver in front of 75,000 fans like the many times over the last 10 years."
Most read in Football
Erling Haaland to miss Man City's clash with Luton in blow for Pep Guardiola
Man United weigh up move for out-of-favour Man City midfielder Kalvin Phillips
'It's his job!' - Roy Hodgson gets slammed for tetchy talkSPORT interview
Harry Kane and Co refuse to speak after Bayern humiliation, but Man United get warning
Ten Hag won Premier League manager of the month for November, but is facing a crucial week in his United tenure.
They face Bayern Munich on Tuesday and are likely to crash out of the Champions League and then travel to Anfield next Sunday to face Liverpool.
Goldbridge continued: "You do have to be very careful over the social media witchhunts. There has been a lot of people in the press and on social media that have been after Ten Hag irrationally for what feels like most of this season.
"The fans in the stadium are behind the manager and are fed up of the players. It's a very important snapshot of reality.
"You go on social media and you think something is going on and the harsh fact for those who want Ten Hag out is that he's not in a sackable position and quite rightly so.
"The fans in the stadium have been watching for years these players who are so inconsistent."