After adding a new Server to the SharePoint farm, I removed the old one.

The central administration page was not accessible. It only said "error 500" in the browser. By changing the admin port via "stsadm -o setadminport -port 12345" and back to the original port, I was able to regain access to the central administration page.