The Londoners wasted a series of chances to kill off the game in the second half, with Jermain Defoe and Gylfi Sigurdsson both guilty of dragging the ball wide when one-on-one with Eagles goalkeeper Julian Speroni.
Tottenham's profligacy almost cost them dearly as Hugo Lloris was forced to make two fantastic saves at the death to keep his team in the lead.
Having been part of the squad that came so close to pipping Arsenal to fourth last season, Vertonghen is aware that every goal this season will be precious and he hopes to see an improvement in the near future.
"We were very dominant, but we kept them alive and they had a big opportunity in the 89th minute," the Spurs defender said.
"We should have more of a killer instinct. If we did we could have scored two or three more, then we would have been able to relax a bit and make more substitutes.
"We were happy with the win. It would have been a better result if we had got two or three goals more."
Despite his concerns, Vertonghen has been impressed with how the four new faces on display performed yesterday.
Soldado showed composure to slot home the winning penalty while Paulinho, Nacer Chadli and second-half substitute Etienne Capoue all showed the drive and creativity that will be required should Bale depart for Real Madrid.
Midfielder Mousa Dembele thinks Tottenham are now in a much better position to challenge Arsenal, who have not spent a penny this summer, for a top-four finish.
"We had quite a good season last year but at the end we didn't make what we aimed for," Dembele said.
"But this year we have learned from this and we can't make the same mistakes again.
"We have the quality (to make the top four). It's going to be very difficult because everyone has spent money, but we have bought some good players too.
"We have also been playing a year longer together. Everyone believes that we can do something this year. We have bought some good players. I can see already that we are playing well, but we can still play much better."
- Sports & Recreation
- Gareth Bale
- Gylfi Sigurdsson
- Jermain Defoe
- Hugo Lloris