Following this blog post I set up Wordpress on an EC2 instance. I've pointed A records to my Amazon EC Elastic IP Address.
After propagation, when I open my website with the domain name, it works. But when I click on other page, it just redirects me to my IP address instead.