DeleteSubKey UnauthorizedAccessException

I'm trying to write a quick app to modify some registry keys. When I'm browsing via RegEdit, I can modify and delete the keys with no problems. But when I try to use RegistryKey.DeleteSubKey() it