First thing is always ask. Especially at a service station. Quite often the water tap beside the petrol bowsers maybe non-potable or recycled water. You don't want that in your tank.
In the country towns, a good place to start is the 'Information Centre'. The staff are usually friendly and after all, there job is to assist the tourist.