The Scot quit the Norfolk club to take over at Aston Villa last summer after taking the Canaries from League One to the Premier League in just two seasons.
He returned to Norwich for the third time on Saturday and maintained his record of winning there with Villa as Libor Kozak scored the only goal of a 1-0 victory on Saturday.
Lambert had to endure jeers from a large section of the home supporters for much of the game but said afterwards that they would treat him differently if he told them the full story behind his fallout with the Norwich hierarchy.
"It's difficult because they don't know the full story," the 44-year-old said when asked how he felt about being booed.
"It's best leaving it at that. I can understand their frustration. Some of them would've wanted me to go anyway so that makes no difference. Certain things happened.
"I had three great years here. It doesn't seem like that. That's just the way it's happened. That's the way a lot of people will portray it. I know what happened and that's football.
"You pick yourself up and you go again. My job is for Aston Villa. The Aston Villa fans are brilliant with me. They have been since I arrived.
"My job is to try to make this club as successful as I can."
Lambert's replacement in the Carrow Road dugout was Chris Hughton and the current Norwich boss was not immune from the vocal home support, with his decision to substitute Nathan Redmond being met with jeering and unrest at the final whistle.
But Hughton, who has seen his side score just once in their last four league matches, received support from Lambert.
"I've got my own job to get on with but Chris has done a fabulous job here," he added.
"No matter what way you look at it he's done a great job. You never like hearing people boo managers. It's a difficult job and he's a really nice guy."