Sounds like the plastic clip on the end of the key cylinder is broken or off.