AVB said as much to referee Andre Marriner when he visited the club's training ground last Tuesday in a pre-planned visit.
Bale has been absent since suffering a hamstring injury against Fulham two weeks ago. In that match the Welshman earned his fourth yellow card of the calendar year for simulation, much to the frustration of the winger and his manager.
"We received the visit of the referee this past week," Villas-Boas said.
"Gareth and I spoke with the referee about this situation. It wasn't big on the agenda, but it was a useful conversation.
"It's a tag that if he has gained it is unfair. But it doesn't bother him in any way, shape or form."