I was able to update to PHP 5.5 following the instructions on http://askubuntu.com/a/109544. But by upgrading to Apache 2.4, the config file got overwritten. And I didn't know what to change to keep it working.
Luckily, I took a Snapshot before upgrading and then I restored from Snapshot. So everything's back to normal now.