Sunday's capitulation against Chelsea followed another loss after leading 2-0 against Brighton back in October.
The result leaves Spurs 11th in the Premier League after winning just one of their last seven matches in all competitions.
Meanwhile, some fans have called for Daniel Levy to leave the club after 23 years.
He is currently the longest-serving chairman in the league, having been in the role since 2001.
Jordan has now given his thoughts on the calls for a change at the club.
READ MORE SPURS NEWS
PGMOL release statement after Chelsea star Moises Caicedo avoids red card
'I'd rather take the blame' - Son issues demand to Tottenham fans in emotional interview
The talksSPORT co-host told White & Jordan: "Who's going to buy Tottenham and pay four billion quid that Joe Lewis and Daniel Levy will want?
"How does it work when you get someone in the door? Because it's working really well at the moment with Manchester United and Jim Ratcliffe, this new intellectual capital that's coming in.
"Just what happened on the field against Chelsea and Brighton has nothing to do with the owner. That's to do with the manager and what he decides to do in the game.
"Now, I do agree that in order for Tottenham to be more competitive, and you go back to the seasons when they'd lost the Champions League final, the argument is, why didn't they back it then?
Most read in Football
David Moyes open to a shock return to former club as he eyes Premier League job
Chelsea fans spot unseen moment where Nicolas Jackson stops teammate getting yellow card
Michail Antonio faces agonising 12 month wait to see if he can return to football
Rooney hires former Man United coach after Plymouth assistant leaves for personal reasons
"People came out, David Pleat sat in the studio and said it was nothing to do with Levy.
"It was to do with Mauricio Pochettino didn't want any new players. Pochettino sings a different song.
"The bottom line is, is if you don't win anything and you're commercially a very successful football club and you built a wonderful stadium, you're going to be sat in a situation where people like Jamie Carragher or anybody else, or even the Tottenham fans that have their moments with Daniel Levy, are going to sit there and say, time for a change."
Levy has overseen Spurs' move to a new training ground and stadium during his tenure.
The club have also won the League Cup and qualified for the Champions League six times since his arrival.
However, doubts remain over the conveyor belt of managers to have failed to end the 16-year trophy drought dating back to 2008.
Current boss Ange Postecoglou is the 12th manager appointed by Levy in the last 23 years.
The Australian is also under pressure after his side's recent poor form.
Following the home defeat to Chelsea, Postecoglou admitted he cannot ask for patience amid their downturn in results.
Spurs are next in action against Rangers in the Europa League on Thursday before next weekend's trip to Southampton.