Yes, but the tanks are designed to keep it sterile and safe. They're not cheap. It's very much an Australian thing (though we used to collect a lot of water in the UK for the garden in 5 × 1000L white plastic tanks in that metal cage (can't think what they are called right now (update IBCs)). It always looked good enough to drink but we never needed to test it. ).
Here in Australia it is very common to be on "tank water" if you're not in a town or city. And in cities and towns you'll still have tanks for collecting rain water for the garden or fire brigade use (Rural Fire Service volunteers). A lot of places will also have bore water which will have a separate pipe work for garden and toilet use. No point in flushing the toilet with your drinking water if you don't need to. In our last rental, the washing machine was also on the bore water with a decent filter in place before it. Living at the top of a mountain this time around we don't have that option, so the backup are 7 dams (it's a sheep farm, so there is serious contamination issues to consider before drinking it and during the drought the dams actually ran dry before we ran out of tank water (we actually didn't run out of tank water, but all you can do at that point is buy it in at $$$$ as our neighbour had to. )
There are quite a few countries I've drunk stream/ river and lake water in, but they are known for good quality water and little to no air pollution. The south of England isn't one of them, but when we lived in the lake district or water supply was from the beck at the back of the farmhouse. That went through a sand trap before getting to us. That was beautifully clean and clear. When I was living in the Scottish highlands, the water was stained brown with peat, but perfectly good to drink.
We see a similar colour residue build up in the kettle here at this place. It's from the gum leaves in the gutters of the shearing shed. They release a pigmentation that permanently stains clothes/ wool etc (and is used to dye fabric) when they soak in water.
I don't think I'd get over my fear something died in the water upstream

I had a fearful set of lectures on waterborne pathogens whilst young and impressionable, not sure I'll ever get past that.
Waterborne diseases are the number one killer in the world. Of course this figure is completely skewed by stats from developing countries with poor water supply but study it for a while and the idea of drinking untreated water, even well stored using well proven methods makes me shudder just a bit.