just throw a <3mm shim in there. You won't hurt anything. I have to do this here and there on many of my bikes.