Google won't count that as two users unless John as two Google accounts with Google+ profiles. You can verify non Gmail address with Google and they should show up as the same contact.
If both addresses are listed under the same contact in Gmail, I'm pretty sure it won't do that (I have a friend with both Google and Yahoo addresses and it identifies her correctly). I bet your Gmail contact list has duplicate Johns and that's why Google+ thinks he's two people.
