The weather is getting hot, is it okay to give my 5 month old a little bit of water between feedings?

A fed baby probably won't need additional fluids as milk adapts to the baby's needs, but a formula fed baby could need some extra water; use cooled boiled water so that it's sterilized.