> give it a prompt and come back an hour or two later.

This is the problem.

If your use case is getting a small handful of non-urgent responses per day then it's not a problem. That's not how most people use LLMs, though.