The Hammers went down 2-0 at the home of their bitter rivals in a game where they battled valiantly, but unfortunately came up short in their battle for priceless points.
It sealed three points which aid Tottenham's Champions League ambitions as they move a point behind Wolves and Manchester United in the race for fifth - which as it stands is good enough - ahead of their games on Wednesday.
For West Ham it was a defeat that leaves them out of the bottom three on goal difference and with Chelsea to play next at the weekend, relegation fears are deepening for the Hammers.
Moyes came to north London, where his side were the first team to win at Spurs' new home last season, to contain their hosts and it made for a dismal opening 20 minutes with little action at either end of the pitch.
And he was left irate after what happened in the final 20 minutes, especially after Declan Rice had a goal ruled out for handball by VAR at Sheffield United at the start of 2020.
"I've only just seen it and I can't believe they have ruled that as a goal after the rules where any handball which leads to a goal is disallowed," the Hammers manager told Sky Sports.
"We had a great goal scored against Sheffield United in the last minute for something and they have not ruled this one out?
"Who is on VAR tonight, do we know who he was? They need subbed I know that. Not very good are they?"
On the performance, Moyes added: "I thought the team worked really, really hard with the shape we wanted to play from.
"We had some chances. There was a lot of good things to take from the game and I thought the players put in a tremendous amount of effort, but ultimately it is the points we need.
"We need the effort, but the points to go with it."
"I can't believe that they've ruled that as a goal."