Neville has not called for Solskjaer to be sacked as United boss, despite their worrying form in recent games.
Defeats at Old Trafford to Liverpool and Man City has piled the pressure on the Norwegian as the Red Devils slip down the Premier League table.
There has been no indication from the hierarchy at the club that Solskjaer will lose his job and he is expected to be in charge following the international break.
The mood has been shifting in the days that followed the 2-0 defeat to rivals Man City.
United legend Ferdinand has called on Solskjaer to 'hand over the baton' to someone else.
He said on his Five with Vibe podcast: "We started this season with such hope but also the transfer window that we had, the excitement, we were all sitting there going 'this is our time now.
"Ole was brought in to get us to that point. He was brought in to get the squad intact, get the players in to make us challenge for the league.
"I sit here now and I don't think we can challenge for this league. I look at our team every week wondering what are we gonna do tactically?
"I don't see any philosophy or identity in the Man United way of playing whatever that should be from the management. I sit here looking confused at the team.
"I was always deep down a bit sceptical, could he take us on to be champions? I wasn't fully convinced - I wasn't sure he could do that.
"But the showing with the squad that he accumulated, to the beginning of this season - and what I've seen this season - I just feel it might be about the time now for the baton to be handed over to somebody else who can take us on now.
"And I think Ole would leave now with his head held high because from when he came in to where he got us at the beginning of the season I think it's been positive."
Neville is unlikely to change his mind on Solskjaer, though, and said he would 'never' throw in the towel in his support for his former teammate.
The former defender was also quick to highlight that it was not just Solskjaer he has thrown his support behind.
Neville also supported David Moyes, Louis van Gaal and Jose Mourinho, with screenshots of his previous tweets as proof.