How to add a directory to the PATH?

How do I add a directory to the $PATH in Ubuntu and make the changes permanent?
askubuntu.com askubuntu.com