Using the vmware-vmx builder I don't see a way to specify the SSH private key to use. The only options I see are:
ssh_username
ssh_password
SSH access using passwords are disabled and I only allow public key SSH. Thanks.
You should use ssh_private_key_file.