Dirty oil damages the turbocharger by causing heavy scoring of critical bearing surfaces.
To avoid damage, oil and filters should be of a quality recomended by OEM. These should be changed when a new turbocharger is fitted and at regular intervals according to the vehicle/engine manufacturers specification.