The Eagles had a busy transfer deadline day, with Wayne Hennessey, Scott Dann, Thomas Ince and Joe Ledley all moving to Selhurst Park - although only former Wolves goalkeeper Hennessey is eligible for the clash at Arsenal.
Sunday's meeting will be the first time Palace have ever played at the Emirates Stadium and Kemp is determined to add points to performances, after fine efforts on the road so far against the big boys have come with nothing to show for it.
"It is a fantastic place to go," he said.
"It is a great stadium and Arsenal are doing well this season. We have performed well in these big games so far, so let's take it a step further. It is a learning experience - the players will certainly take some confidence from those performances.
"You have to set yourself up to be difficult to play against, but at the same time we went to Man City, Tottenham and Chelsea and had chances and actually have played very well and should have got something out of all of those games.
"That has to be the disappointment to us, that we haven't got something out of the game, and that will be the target on Sunday; go to one of the bigger clubs, play well and actually get some kind of reward."
After recording consecutive 1-0 wins over Stoke and Hull, Tony Pulis' side moved up to 14th in the table, giving the squad a lift and no doubt helping to attract new faces to the club for the remainder of the campaign at least.
Kemp, who took over media duties on Friday with Pulis working on transfers, believes those results mean the players will make the short journey to north London in good heart.
"Back-to-back wins in the Premier League are difficult and it is good to get them," he said.
"When you've won them you can move on with a bit more confidence. We go into the Arsenal game on the back of two wins, so that will give us a boost."
- Sports & Recreation
- Wayne Hennessey
- Scott Dann
- Joe Ledley