I have run sudo apt-get remove php5 and it says php5 is removed but I can still load phpinfo() from one of the web pages and all the websites still load. I have also restarted the server.
I don't know how to remove the dotdeb version of php, I just want to wheezy packaged version.