The Saddlers let a two-goal lead slip to draw 2-2 with Yeovil on Saturday, stretching their winless run to 16 games.
Dean Smith's men have the second-worst record in npower League One in games in which they have scored first, and Brandy says that is a problem which needs to be resolved quickly.
He told the club's official website: "Obviously, from the position we were in, we expected to see the game out.
"It's certainly something that needs to be rectified and sorted out because its not the first time that it has happened.
"We're still going into games in a positive frame of mind and actually dominating for long periods, but we just need to find that extra percentage to be able to see out matches."