Granada and Cadiz played out a 0-0 draw at the Nuevo Estadio de Los Carmenes, but the match was overshadowed by the alleged racist incident.
Equatorial Guinea international Akapo was substituted an hour into the match and walked around the side of the pitch back to his side's bench.
A fan allegedly made m gestures towards him, and he confronted the culprit.
Akapo told GOLTV and El Larguero: "There have been three or four a**holes. I know it's wrong, but they don't represent the Granada fans at all.
"But above all there was one who has persisted and has called me a m. On the one hand it affects me and on the other we have to give visibility so that people are not in the stands.
"They are people who do not deserve to come to the stadium and who do not represent the fans of Granada. It doesn't enter my head why people insult you and call you Black.
"For my part, I treat him calmly, and I try to make people see what idiocy and nonsense they do. I hope they remove him from football.
"Many thanks also to the Granada fans who told him to stop. I will try to forget it. Football is about having values of respect."