The Italian, who was appointed in November, has undertaken a massive rebuild project in north London, previously stating that the squad was 'weakened' in January.
One of Spurs' biggest problems has been their inconsistency, highlighted by the fact they won 3-2 at Manchester City in the Premier League but then lost at Middlesbrough in the FA Cup.
Conte says this has been the story of Tottenham for the last two decades, which has coincided with Daniel Levy's reign as chairman.
"For sure, to have this up and down I don't like," Conte said. "I always said this from my first day when I arrived.
"Tottenham's story is this, many ups and downs, but to be competitive, to try to win something, to try to fight for something important and become a strong team, the first thing that has to happen is to be stable and avoid these ups and downs.
"To do this and to change this type of situation that is happening for many, many years in Tottenham, it's not simple."
Conte appeared to agitate towards the exit door at Spurs in an exclusive interview with talkSPORT following a 1-0 loss to Burnley in February, but later claimed it was a motivational technique.
Last time out Spurs' trophy drought was extended to 15 years as their last chance of silverware was ended by second tier side Boro.
Conte has explained that it will take plenty of work to get Spurs out of the losing habit, and neither he nor any other manager could make a quick-fix.
"In a short time, it's impossible to do this," he said. "Not only for me but I think for any manager or coach to come in and change the story in one second.
"This story of this club for the last 20 years. Especially when this club for 20 years has this type of situation."
Spurs are back in action when they host Everton on Monday night and they have some good injury news with Rodrigo Bentancur and Lucas Moura back from injuries.
Oliver Skipp is still out with a groin injury, with Conte last week saying he hoped his medical staff could rush him back.
But this week Conte said: "It is a pity I think in England that sometimes you should have a conference with the medical department.
"The doctors, it is too easy for the doctors to work here, because they don't speak, they don't explain what happens, you understand?
"Sometimes I think that could be good, one day, if in two weeks, to have a good press conference with the medical department to explain about the situation of the players, about the situation that they are trying to take care of their players. It is too easy for the medical department in England, I think so.
"He's not ready, he's having this problem with groin pain, and is fighting and he could recover before but maybe something was wrong, and now we have to wait."