Does an increase in CO2 in the atmosphere imply a decrease in oxygen levels?

You are right. The falling oxygen levels have been measured, and match the rising CO2 amounts, even matching the annual fluctuations, although compared to the 20% or so background oxygen the changes are very small.