DIAGNOSIS Residual cleaning solution (vinegar or descaling solution) is trapped in the water lines or on the evaporator plate.
FIX You didn't rinse enough. Run multiple rinse cycles. Fill the tank with fresh, cold water only. Run a full ice-making cycle. Discard that entire batch of ice. Repeat this rinse-and-discard process at least three times.
IF THAT DIDN'T WORK The taste might be from the new plastic of the water reservoir or tubing. Soak the removable reservoir in a baking soda and water solution overnight. Rinse thoroughly.
HEADS UP Never use bleach or harsh chemical cleaners. They will permeate the plastic and the taste will never fully go away. Use only food-grade citric acid or white vinegar for cleaning, followed by aggressive rinsing.