how far back (how long) are the updates kept on file?

Updates are stored forever. In fact, you can still access the very first tweet ever sent to Twitter.

The feature allowing you to go back to see your old tweets is currently limited. For most users, it's about 40-50 pages back on your profile, however, tweets aren't forgotten or deleted, unless you a) delete your account or b) delete the tweet yourself.