United fell to a 1-0 defeat at Old Trafford as Kortney Hause headed in an 88th minute winner, with Bruno Fernandes missing the opportunity to equalise from the spot in stoppage time.
Last time out in the league against West Ham, Man United were denied multiple appeals for penalties, with the Hammers then given a spot-kick in added time, which Mark Noble missed.
The tables were turned today for United, and Solskjaer not only complained about Villa players distracting Fernandes, but also the away side's goal.
"The way they get around the penalty spot, get around Bruno and all that, that's not to my liking, but I do understand it, but it shouldn't be that way," Solskjaer told Sky Sports.
The Norwegian manager then explained his upset over the goal to talkSPORT.
"The biggest disappointment is that their goal is offside," he moaned.
"[Ollie] Watkins is clearly impeding David [de Gea] he's actually touching him as [Kortney Hause] is heading, so how that can not be given as a foul or an offside, I don't know"
"That one is a massive decision and it's a match-deciding one, so unfortunately, it went against us again and we'll have to battle on, one of these days we'll get one."
Solskjaer was asked by talkSPORT's Alex Crook about the decision to have Fernandes taking penalties over new signing Cristino Ronaldo, who was taunted by Villa goalkeeper Emiliano Martinez.
"Bruno's been excellent," Solskjaer said. "Cristiano is an excellent penalty taker as well so that was Bruno's moment and unfortunately he didn't score this time but he's done it so many times before
"Let's see if we get another one, we don't know if we'll get any more penalties, with the decisions we're getting against us at the moment."
Ahead of the loss to Villa, Solskjaer opted to bring penalties into the spotlight, referring back to a comment made by Liverpool boss Jurgen Klopp.
"We just have to hope we get what we deserve and we should have had three penalties in the last two games," Solskjaer said before the game.
"I don't know but there was a certain manager last year who was starting to worry about us getting penalties and after that it seems like the decisions are more difficult to give.
"I've seen a big, big difference since then but you just have to leave it to the refs and hopefully they'll make the right calls very soon."
The problem is, even if you win a penalty, you still need to score them.