That's what you get with biospheres. You can't perfectly balance oxygen.
Adding plants will generate more oxygen, but you will never be able to perfectly balance it, because the amount of oxygen plants produce, and the amount of oxygen animals use, depends on their health percentages, and those are always in flux.