Kevin Dawson's first-half shot proved to be the difference between the two teams, but Brown remained upbeat despitehis side's first-round exit.
"I thought we had the performance but not the result, but I'm relatively pleased with our performance," Brown said.
"Yeovil showed their Championship quality at times, which did make a difference, but our desire and will to win was certainly there and we got more in to it the longer the game went on.
"We could have snatched an equaliser at the end and maybe we didn't deserve to lose.
"There were some strange and curious decisions from the referee which didn't help but I'm not here to moan about him and overall I'm quite pleased with how we did.
"The result wasn't there but progress has been made and we got a few more minutes out of players who needed a game as well."