I think there's some context missing when we're talking about the singularity, this is the whole Marcus "AI is hitting a wall" debate (maybe I'm reading part of that reference in your comment and it isn't there). For different people "hitting the wall" means different things and we're not really communicating well with one another. Marcus is concerned about AGI while others are concerned about ML in general and what it can do. So LLMs and LGMs (like Dall-E) are showing massive improvements and seem to be counter to Marcus's claim. But from the other side, there's still issues with solving AGI with things like causal learning and symbolic learning. But what's bugged me a bit about Marcus's claim is that those areas are also rapidly improving. I just think it is silly to say that Dall-E is a proof that Marcus is wrong rather than pointing towards our improvements in causal learning. But I guess few are interested in CL and it isn't nearly as flashy. I know Marcus reads HN, so maybe you don't think we've been making enough strides in CL/SL? I can agree that it doesn't get enough attention, but ML is very hyped at this point.