Spurs surrendered fourth spot to Everton after conceding twice in added time to lose 2-1 after Clint Dempsey had given them the lead at Goodison Park.
The top two spots in the Barclays Premier League are occupied by the Manchester clubs, United and City, who have opened up a gap but third-placed Chelsea are only three points ahead of the Toffees, Spurs and West Brom.
It seems fourth will be the most keenly-contested position which is why Gallas is trying to look beyond to the top three.
But he accepts there is some distance still to travel.
"We have to pass one more step to be on the [same level as the] top three and I don't know when it is going to happen," he said.
"I hope it will this season but it is a shame because when we get very near, something always happens and we draw or lose.
"In our squad we have some players that have experience now so I don't think it is about a lack of maturity.
"For example, yesterday (Sunday) we did almost everything right but they scored that goal which killed us. It is difficult to explain but sometimes you need luck.
"When I was at Chelsea we had that luck to win some games even if we were not playing good but Tottenham is different. I hope it will change this season or next."