I find most water bottles can freeze fine without removing any water. There is often a little bit of air already at the top and the plastic bottle is fairly flexible. Usually the base just gets balloned out a bit and difficult to stand up. I've frozen many water bottle for various reasons and can't recall any breaking from just freezing.