Woohoo! I have passwordless access to my web host now. Next stop rsync.

BTW, I had one wrinkle with ssh-copy-id in that my host makes me use a non-standard port for ssh. I found the answer here: http://superuser.com/questions/446665/how-to-use-ssh-copy-id-on-a-non-standard-port

Essentially:

ssh-copy-id '-p 12345 user@computer'