Given that you are experiencing some degree of cognitive dysfunction in addition to pain as much as a few days post injury, I would be very cautious. Monitor the pain closely, and if you begin to experience it in greater degrees, or if you begin to experience other neurological symptoms such as difficulties with your gait, vision, sensation, hearing, etc, I would get yourself to the ER quickly, and request a CT.
As mentioned by a previous poster, some types of head injury do not show up on initial CT, but may be more visible at a later time. More specifically, if your crash initiated a small bleed in one of the vessels that lie in the layers of tissue between your skull and brain, this bleed may not have been detected in the initial CT. Follow-up CT may be more sensitive as larger amounts of blood may have accumulated by this time. This continued accumulation of blood can ultimately cause compression of the brain which can then result in headaches or ultimately, unconsciousness and death. Not something to take lightly.
As stated by a previous poster, it's also true that CT scans are unable to detect all types of brain injury. Commonly within TBI, an individual is likely to experience white matter shearing (which is simply fancy neurology/neuropsychology speak for tearing of the cells that connect some brain regions to others). This poster was correct in stating that a 3 Tesla MRI would be more likely to be able to detect this type of injury, but even with this detection, not terribly much is known about the precise consequences of such an injury. It isn't true though that MRI would be more sensitive to detecting any accumulation of blood on the brain.
Suffice it to say that you may experience difficulties with focusing and maintaining your attention for some time period, and you may have some degree of memory difficulty for a little while. Ultimately, however, the research on mild TBI shows that there is usually very little noticable deficit in the long term.
Good luck, and keep close tabs on the pain and any other symptoms that you may experience. If you are very cautious, you will just suck it up and head on over to the ER. I'm of the opinion that with your brain, it is far better to be safe than sorry.