How do you add gravity to a character controller?

I'm using the character controller from the standard assets, and I want to put gravity on it. I can't use rigid body because the controller is already there and it doesn't seem to work when I add the rigid body on. Thanks!