The Glovers' 2-2 draw with struggling Walsall last Saturday left them 14th in the table, seven points off the play-offs and nine clear of the relegation zone, and Johnson says that is not good enough.
"I don't want to be 13th or 14th in the league," he told this is Somserset. "That's no good to me and if they are happy there then I don't want them here.
"We want to be competing with the top 10 teams at least and to do that we've got to win three or four.
"At the moment we are proving we are not good enough yet to win those three or four on the trot. We are going to try blinking hard."
Yeovil host Oldham, a side just four points and two places below them, at Huish Park on Saturday before trips to Bournemouth and Portsmouth.