The Dons fell four points behind Ross County in the Clydesdale Bank Premier League and saw their hopes of a top-six finish take a blow when they lost 1-0 to the Dingwall side at Pittodrie on Tuesday night.
Aberdeen have only taken two points from six games against high-flying Highland sides Inverness and County, and Rae knows time is running out to prove themselves.
Rae told RedTV: "It's difficult - fans are always impatient and I can understand that because everyone wants to see their team doing well.
"I support the team as well, I have supported the club all my life.
"It's difficult seeing the club like this and not doing as well as we would like.
"I don't think it's that far away but you don't get that time in football to produce what you want to.
"We have got to make sure points come on a match day.
"We are probably not scoring enough goals apart from Niall (McGinn).
"There is a lot of quality and talent but it's about showing it in a game."