The England midfielder was blasted by former Hammers striker Dean Ashton as he was booked twice in the space of five minutes in a defeat to Nottingham Forest.
Phillips joined West Ham in the final days of the January transfer window from Man City, but it has not been the signing under-pressure manager David Moyes would have expected.
Three minutes into his first game in a Hammers shirt, Phillips gifted Bournemouth a goal in a 1-1 draw with the Cherries, and it took just four games for him to get his first red card for the club.
He earned his first yellow card against Forest for a needless push on Nicolas Dominguez, but he did not heed the warning from the referee as he was soon sent down the tunnel after a rash challenge on Morgan Gibbs-White.
Ex-Hammers striker Dean Ashton was watching the game for talkSPORT, and was not happy with the January signing.
Read more on West Ham
Forget Henderson and Phillips - stats show Luton star is the man for England at Euro 2024
Kevin Nolan reveals text from Declan Rice ahead of Kalvin Phillips' loan move to West Ham
He said: "The first booking is stupid because he just pushes Diminges to the floor when he doesn't need to, and then he goes in at knee-height to try and get the ball, he doesn't get a lot of it and gets Gibbs-White instead.
"It's been, let's be honest, an absolutely shocking start to his West Ham career for Kalvin Phillips. He's clearly been sat on the bench for far too long and he is nowhere near up to speed!"
It appears Phillips is really testing Gareth Southgate and the England manager's record of selecting him ahead of this summer's European Championship.
This was only Phillips' eighth Premier League appearance of the season, and yet it was his second sending off of the campaign.
Most read in Football
Cunha out injured but only Chelsea and Liverpool boast better Tottenham record than Wolves
Brutal camera angle shows moment Liverpool star Diogo Jota's knee was injured
Tottenham above Arsenal and only behind two European giants in financial report
Klopp can barely watch as Liverpool suffer treble injury blow ahead of Carabao Cup final
It reduced West Ham to ten men with just 30 minutes left to play, with Moyes' men eventually succumbing to a 2-0 defeat at the City Ground.
Forest won the game two goals at the end of each half - Taiwo Awoniyi opening the scoring on the brink of half-time and Callum Hudson-Odoi adding a second in the fourth minute of stoppage-time.
Footage resurfaces of Kalvin Phillips' heartwarming moment with West Ham fan with midfielder set to arrive at London Stadium on loan
Jamie O'Hara also had his say on Phillips' sending off and insisted there's no way he can be selected for the England squad in his current state.
"Kalvin Phillips can't go to the Euros, he looks unfit, he looks way off the pace," said the talkSPORT pundit and former Tottenham man.
"He got sent off for two stupid yellow cards, he's mistiming tackles because he's not been playing, he's rusty.
"He's miles off it, he can't go to the Euros at the moment. He's gone there to get back playing, but actually he's making West Ham worse!"
Ashton agreed, adding: "I just don't see how you can take him."