Did you add an A record for mail.mydomain.com ?

Once you're done adding both A and MX records, you should be able to run the following commands from any computer:

nslookup mail.mydomain.com 

AND

nslookup -q=mx mydomain.com

The first command should return the public IP address of your network. The second command should return mail.mydomain.com.