Max Power's stunning strike from the edge of the penalty area settled matters just after the hour mark, with Jose Baxter going closest to an equaliser when he rifled a 25-yard free-kick off the underside of the crossbar.
The defeat saw Oldham suffer their second successive loss since their fine FA Cup run came to an end and they are still anxiously looking over their shoulders in the relegation positions.
Philliskirk said: "We are disappointed because there was nothing between the teams. We feel a bit hard done by because I thought we deserved to have been given a blatant penalty for handball.
"I thought we didn't play well in the first half but after the break I don't think we deserved to lose.
"When you are at the bottom things just don't go right for you but we can't feel sorry for ourselves.
"It is still in our own hands and we have two home games now which are massive for us.
"We had chances to score but the pitch dictated the way the game was played. It was a bit of a pudding and we feel things are conspiring against us a bit.
"We need to stay upbeat and but we need to anticipate the ball better in the penalty area. We seem to react after the event and that is hurting us at the moment.
"I don't feel we are far away."