After a Stephen McManus own goal gave Killie the lead, Well took the points thanks to goals from Henri Anier and John Sutton.
Kilmarnock striker Kris Boyd came close on several occasions before Hollis rescued his team with two late saves following Well right-back Ramsden's red card for a late tackle on Rabui Ibrahim that earned him a second booking following a yellow card for dissent.
McCall lauded Hollis, who was handed the gloves at the start of the season despite the signing of Gunnar Nielsen.
"Lee Hollis has made two fantastic saves," McCall said. "It doesn't matter how you keep them out, one came off his knee and one came off his heel, and over the piece I think we did deserve to win.
"Lee has not had a great deal to do in the games we have had of late but today when he was called upon he made some crucial saves.
"That's what he is there for. He is getting pushed all the way by Gunnar. They both train ever so well and push each other.
"You need good competition all over the park and we have certainly got that in goal."
- Sports & Recreation
- Lee Hollis
- Henri Anier
- Kris Boyd