But it looks like they may have a reason to start using his name slightly more regularly after the striker re-signed for the Selhurst Park club.
As confirmed by BBC Sport, the South London club have signed the 33-year-old on a short-term deal until January.
The striker scored 85 goals in 160 appearances during his last period with the club and he will also take up a coaching role with the Glaziers.
After signing the deal Johnson said: “I am delighted to be coming back to a club that I love and have a real soft spot for.
“I would like to thank the gaffer and the chairman for giving me this opportunity and I am looking forward to helping this football club have continued success in the Premier League.
“I have also been given an opportunity to help the youngsters in a coaching capacity, something I am really looking forward to getting involved in.”
The Londoners, recently taken over again by Neil Warnock once more, also brought Chris Kettings, Frazier Campbell, Brede Hangeland, Martin Kelly, Ezekiel Fryers, James McArthur, Wilfried Zaha and Kevin Doyle to Selhurst Park this summer.
Crystal Palace fans. Is the signing of Johnson a gamble worth taking? Does he still have something to offer in the top flight? Let us know your thoughts below.