Add the links to the ReportServer from the Windows Azure Portal
There is the web service URL on the Windows Azure portal page for reporting services, you should add links the ReportServer while you are at it.
Nikolai Blackie commented
Yes that simple, just a link through to where you can navigate the reports, when you first start with the CTP it would save a little time.
Mary Beth Thome commented
Do you just mean that we should add the /ReportServer to the URL displayed and make it clickable?