Saints suffered relegation from the Barclays Premier League eight years ago under the supervision of Redknapp, who then quit to re-join bitter rivals Portsmouth a matter of months later. That period still rankles with many Southampton fans, who will no doubt make their feelings known when he brings bottom side QPR to the south coast tomorrow.
"Listen, I will get a bit of grief, won't I? But what can you do? That's no problem," he said.
"They are not bad people there. I wouldn't say Southampton supporters are nasty, aggressive people. They're not. They're good supporters and they'll give me a bit of grief but that's life. I accept that. I will just get on with. I won't lose any sleep over that. I will only lose sleep if the result is bad."
Anything but victory for QPR could prove disastrous for a side already seven points adrift of safety at the bottom of the Premier League.
That is where Southampton ended the 2004-05 season under Redknapp but he insists he has a clear conscience.
"Listen, no one was more upset than I was that the club got relegated that year," he added.
"When I went there were four teams cut adrift by miles and we just couldn't get out of it.
"I gave everything I had and that's all you can do. You can look yourself in the mirror. No one tried harder than I did. You can only give your best at the end of the day. You are relying on players. I have said when I have been successful and done well at Tottenham, it is about good players. That is what the game is about.
"If you've got good players, it is an easy game. You send them on the pitch and off they go. They perform week in, week out. It's easy and the better players you've got the easier the job is."