The Parkhead side are 1-0 up from the first match in Glasgow and know a draw against the Swedish champions will be enough to take them through to the play-offs.
Celtic reached the last-16 of the competition last season and, with that in mind, the Hoops boss will send his players out in a positive frame of mind as he looks to take another step towards the group stages, his initial goal.
Lennon said: "We have won one, and we don't have to win, a draw will suffice but we are here to win this tie.
"Last season has given us the experience, we have been down that road before but it counts for nothing.
"I am more pleased that we are a week further down the line in terms of match preparation that had been beneficial to the players.
"The Champions League is what we look forward to.
"We were starved of Champions League football for the last few seasons up until last season and you could see what it meant to so many people in the country."
Celtic goalkeeper Fraser Forster believes the Swedish side will pose more of a threat on their own ground than they did last week in Glasgow.
"They came and sat back last week which they obviously won't do this week," Forster said.
"I would imagine that they will come at us. It will be a tough game, no doubt about it.
"You are not champions of your own country without being a very good team. We got a good result last week but the job is only half done."
However, Elfsborg manager Jorgen Lennartsson stressed that his side will be in "no rush" to get back on level terms.
"There is no stress on us to score early," he told Press Association Sport.
"If we score in the 65th minute to make it 1-0 then the pressure will go on Celtic.
"So we don't feel it necessary to be on the offensive right from the beginning."