You can store currency or gold in various non-interest-bearing ways in the current free market. It isn't a very attractive option compared with banks, however as stored money (metal-backed or otherwise) that isn't lent or invested necessarily loses value on average, in the long term against currency that is.