There are BPA free water jugs available. and yes, it would be smart to clean them before each fill (scolding water or vinegar is also an alternative to bleach). However, all municipal water sources have chlorine and fluoride to the supply, which counter to popular belief, are devastating on your health. Yes, some bottled water is nothing more than just tap water, but others are not. And yes, some add minerals for flavor, but also health, as many American diets lack proper minerals needed for ultimate health.
Instead of offering no helpful advice what-so-ever, most of you may want to do some research and realize what's truthfully beneficial before spouting your mouths and making useless, demeaning, sarcastic remarks.
There are sources of pure water that filter out not only organic contaminants, but do not include chlorine or fluoride and other hormones and pharmaceuticals that contaminate most municipal water supplies. I apologize that I can't give you specific examples of where to find these sources in your area. If you would like a source that you know you can trust because you service the filtration yourself, you could invest in a faucet attachment filtration device and fill your own bottles, for example at http://waterfilters.mercola.com/products/drinkingwaterfilters.aspx
It's definitely a steeper start up cost, but when it comes to healthy water, crucial to your health, that's your decision to make. The filters should also last quite a while if you're only filling 5 gallon bottles.