Primo Five (5) Gallon Bulk Bottled Water

We purchased a new water cooler recently and also purchased this 5 gallon jug with water from Primo. The water has a distinct "plastic" taste that is seriously off-putting. We plan to refill it at the water store down the street and hope that a different water brand will not have the same taste - although we suspect that leaching from the Primo plastic bottle may well ruin any water that ends up in it. If a second batch proves to taste like plastic we will be ditching this bottle and going with another product. We didn't purchase a water cooler and bottled water so that we could taste plastic.....