Emma Hayes's side needed just a point to be sure of a top-two finish, but goals from Sophie Ingle, Fran Kirby, Katerina Svitkova and Maren Mjelde got the job done for the Blues in convincing fashion.
It took all of 12 minutes for Chelsea to draw first blood on Albanian turf, as Ingle met a deflected cross from Guro Reiten just inside the area and produced a fine side-footed finish into the bottom corner.
The Women's Super League champions had their second on the 20-minute mark, but the goal was mired in controversy, as Kirby was played through following a quick free kick and finished clinically.
Vllaznia felt aggrieved at the decision, but the goal was allowed to stand, and Hayes's team continued to dominate possession inside the Vllaznia half as the game entered its dying embers.
Not until the 87th minute would the pressure pay off again, as substitute Svitkova met Jelena Cankovic's inswinging ball to direct a header past goalkeeper Kaylin Williams-Mosier, who had come charging off her line to no avail.
Chelsea would add a fourth deep into stoppage time after Sara Maliqi was adjudged to have handled the ball inside the box, and Mjelde made no mistake from 12 yards before the final whistle blew.
Hayes's side could end the night as Group A winners if Paris Saint-Germain fail to beat Real Madrid in the 8pm kickoff, but they may have to wait until next week's meeting with the French side at Kingsmeadow to confirm a first-placed finish.