I ended up writing my own mini-utility for this: https://github.com/jrockway/dotfiles/tree/master/bin

But I think I am going to switch to puppet, because there are a few things I always need done on a new machine; adding myself as a sudoer, installing packages, editing the imapd config (for a local imap cache), etc.