Combine water and ground coffee in a French press; stir to ensure coffee is evenly mixed with water. Push the plunger halfway down slowly. Let coffee steep at room temperature for 20 to 24 hours.
Mix milk and sugar in a pitcher until sugar is dissolved. Push French press plunger all way the down; pour coffee over the cream. Divide coffee mixture among 4 glasses; top with ice.
