Unlabelled datasets are valuable in themselves.

Self-Taught Learning: Transfer Learning from Unlabeled Data

http://www.andrewng.org/portfolio/self-taught-learning-trans...