I hope you're not talking about the shipping protectors on the ends of the axle (outside if the frame). if so, throw them out. Or, in the enviro-speak, dispose of them properly.
If you're talking of the weather seals on the outside of the shell coming off and flopping around on the axle, then it depends on the hub, and I'm not familiar with the xero lites.
Some hubs use a press or snap in design, which if put together correctly tend to stay put. Others aren't toleranced so well and might need the help of an adhesive.
If that't the case, you'll need to use some solvent on a rag to get both the seal/cover and the mating area of the shell perfectly clean and dry then carefully glue it into place. I've done this sucessfully with rim cement (I ride tubulars) but rubber cement, or a Anerobic adhesive (Loctite) should also work.