Sol Campbell has called on football's authorities to deduct points from clubs whose supporters are found guilty of ­indecent and racist chanting. The Portsmouth captain, speaking in an interview with the Guardian, has long been the target of abuse from Tottenham Hotspur fans, who have never forgiven him for leaving them for Arsenal in 2001, and was subjected to vile chants during Portsmouth's 2–0 Premier League win over Tottenham at Fratton Park last September.

"I think that they [the game's authorities] are going to have to do more," said Campbell. "My situation is a small part. But also, you have the racial abuse in the rest of Europe. The only way you can stop it from happening is by taking points from clubs. Then it would definitely stop. If it's just way over the top and you start taking points ... [with] those three points, you can lose the championship or you can be going down. That's the only way you can stop fans' abuse on that type of level.

"There is all sorts up and down the league, there is always someone saying something or part of the crowd saying something to certain players, but there is a level and once that level is crossed, I think people have to step in and sort it out.

"Football seems to think it can keep on going without getting checked. In most other sports on this level, it doesn't ­happen. You're not going to get that in ­tennis, rugby, cricket or athletics. It's just not accepted."

Hampshire police launched an investigation into the abuse suffered by ­Campbell that they hoped would set a precedent. After releasing photographs on the ­internet of 16 suspects, they brought charges of "indecent chanting at a designated football match" against 11 people. Their ages ranged from 13 from 54.

Four of the 11 Tottenham fans to be charged pleaded guilty and they were fined and given three-year football ­banning orders. The magistrate likened them to a "pack of animals". The remaining seven pleaded not guilty and they face trial in May.

"The arrests woke up a lot of people," said Campbell, "because some people just thought 'I never thought it was wrong' – that's unbelievable – [or] 'That wasn't me', as if football turns people into some different kind of person. 'I've paid my money and I can say and do whatever I want at any time I want within that 90 minutes'.

"There is a level. You say that on the streets and you'd be arrested or put away. You wouldn't say that to your son or daughter and if that was said to your son or daughter, would you be the same? That's what people have to remember."

Campbell also voiced his concern that Portsmouth had missed the opportunity to establish themselves as regulars on the European stage and were now drifting towards an uncertain future. Portsmouth, who play Chelsea at Fratton Park tonight, are two points above the relegation zone and they remain under the caretaker charge of Paul Hart, after the sacking of Tony Adams three weeks ago. Sven-Goran Eriksson, the Mexico manager, is their No1 choice to take over. "There is a guy that they are out there to get but there are a few sticking points," said Campbell. "I think that's all a waiting game."

Campbell lamented Portsmouth's ­failure to build on last season's eighth-place finish and FA Cup triumph. The club, which is up for sale, has sold key players and remains deeply in debt. "It's gone now," he said. "In the sense that to get back to the level of European football on a regular basis, it's going to take a big effort over the seasons."