The visitors took a shock lead at the home of the seven time champions but goals from Kaide Gordon, his first competitive strike for the club, a brace from Fabinho and Roberto Firmino sealed the Reds' place into the fourth round.
Even though the hosts have several first team players unavaible through injury, COVID and the Africa Cup of Nations, Jurgen Klopp was still able to field a starting eleven that contained Virgil Van Dijk, Fabinho and Andy Robertson.
Whilst there were a number of first team players on the field, it would be the Leage One side who broke the deadlock.
Conor Bradley got isolated against Nathanael Ogbeta who brought down a ball before whipping in a wicked low cross that Udoh got on the end of in between the Dutchman and Ibrahima Konate then proceeding to perform Ronaldo's famous celebration.
It was a wonderful moment from the hosts but sadly did not last long as Bradley made amends minutes later by producing a low cross that Gordon latched on to before firing in the equaliser in front of the Kop.
The goal meant that he became the second youngest scorer in Liverpool's history.
Once Liverpool got back on terms, they looked like their old selves and just before half-time had a great opportunity to take the lead after captain Ethan Ebanks-Landell handled the ball in the penalty area.
Fabinho stepped up and converted the penalty sending the ball into the left corner of the goal.
Speaking on talkSPORT, former Sunderland left-back Micky Gray felt the goal was harsh on the visitors but said they could have no complaints about conceding the penalty.
"Well if there was ever a time not to concede a penalty, its just before half-time, but one silly mistake from your defenders, you cannot raise your arms," he said.
"I'm not saying they deserve to be in front at half-time and I think 1-1 at half-time would have been a fair result."
Liverpool kept control in the second half and a very cheeky backheel by Firmino late on in the second half meant that there would be no drama at the end.
Alongside the fans that were in the ground, Gray was in awe of the brilliance from the Brazilian.
"How cheeky do you want to get? It's an outstanding finish from Firmino, we've seen it over the years, it falls to Firmino he has his back towards goal, if he turns it probably gets blocked, it's so cheeky."
The hosts then added further gloss onto the score line when Fabinho smashed the ball in from close range from a Kostas Tsimikas free kick.