The England international has been a consistent figure in between the sticks since he joined the Gunners in 2021.
However, the arrival of David Raya from Brentford in the summer has seen Ramsdale lose his spot as Arsenal's no.1.
He has since admitted that being dropped to the bench has been 'difficult' and he is 'hurting' for not playing in the team.
Arteta has now told him what he needs to do to return to the starting XI, with Raya set to remain as his first choice this season.
Speaking ahead of their London derby away at Chelsea, he said: "It's not easy for any player when he's not playing as much as he would like to.
READ MORE ON ARSENAL
Tottenham are top so far, Man United have worst signing but Arsenal own 'captain of flops'
Ramsdale 'hurting' over Arsenal role and explains his dad's row with Carragher
"The only way to do it is to work harder, to show the passion that you have for the game, to contribute to the team in a different way.
"And when you get an opportunity, do your best and try to help the team to win the game."
Ramsdale started in Arsenal's opening four Premier League games of the season, keeping one clean sheet in an unbeaten start.
He also played in their 1-0 Carabao Cup win at Brentford but has not featured in the Champions League.
Most read in Football
Liverpool vs Everton build-up, Arteta challenges Ramsdale, Man United takeover latest
Tottenham are top so far, Man United have worst signing but Arsenal own 'captain of flops'
I played for West Ham - now I coach Greece and have undergone huge body transformation
Tottenham fans love Dejan Kulusevski 'getting the badge in' but feel sorry for Eric Dier
Raya has started in both of their European contests since he joined in August and last four league matches, including the north London derby against Tottenham and win over Manchester City.
The Spaniard has kept a total of four clean sheets for the Gunners and is set to start in their trip to Stamford Bridge on Saturday.
Arsenal sit second and level on points with Spurs going into the game and won both their meetings against Chelsea last season.