How can I tell what servers I am deploying to in Octopus?

Go to the "Infrastructure" tab at the tabs across the top and then pick "Deployment Targets" from the menu at the left.