Here is a very short and basic video on how to add an A record in your Windows DNS. Note that you will need to have your server setup as a domain controller or install the DNS role.