Am I increasing or decreasing a voltage?

This may seem daft, but if I decrease a voltage output of a battery (5,4,3,2,1,0) but then continue to go into negative values for the voltage (...-1,-2,-3) am I still decreasing the voltage or am I increasing it negatively?