Staff at a community-run swimming pool say it is in a "difficult financial position" and needs more members or funds to.