Paddy Madden and Matt Dolan scored either side of half-time for Yeovil, with Alan Judge equalising for the hosts from the penalty spot in the 49th minute.
Kiwomya felt defeat was harsh on his side, but will look to draft in some more forwards during the summer.
He said: "I thought in the second half we were the better team and created the better chances and we should have got at least a draw.
"The lads tried to play on a difficult pitch and made the right decisions. If we put our chances away then it's a different game, but it is small margins in games.
"We came up short again and there will be changes in the summer. I don't know about lots of changes, but there will be changes.
"My priority will be in the forward area in that final third, which is where we have come up short all season.
"I would like a pair of strikers, definitely. I've got a long list of targets at the moment, we need that killer touch that we lacked again."
Kiwomya added: "But it's not all negative, we have some good players in that dressing room.
"We were much better in the second half and, as I say, we feel we should have at least got a draw."