Have you checked the headset and stem bolts? The brifters could also be loose or moving a bit. There are lots of things it could be.