Contact form not sending out email from my website / Using PHP / Ubuntu 13.10 x64

I’m currently unable to receive emails from the contact form on my website, I created the form linked to a php file. I’m new to this and at first I didn’t know that PHP had to be installed in the server, and when I submitted a filled out test form from the website, the php file opened up. After looking at this issue, I installed php5 on the server, and when I submit the form everything looks to be working ok, it redirects to an html message and secondly to the home page just as it is intended to work. But I don’t receive an email after it, I have tried it like 7 times and I just don’t know if the email is sent elsewhere, or is just not sending it.

I have checked the php file to see if it has the correct address already. My only guess is that something else has to be installed in the server for it work or maybe the server is blocking emails from going out.

Please Help