A handful of cities in the US have in the last few years gotten a service called car2go, which is exactly what you describe. It's not available in the biggest cities, though. A few cities are also starting to have bicycle-sharing services. It's just not very common, yet.