Believe me: I would have been thrilled if one of the larger commercial entities using Rails had solved A/B testing before I did, but since nobody seemed to be working on it, it was either write my own or use Google Website Optimizer.
A/B testing is totally worthwhile for an Internet business even at small scales. I can't say enough good things about it.