@dpwiz@qoto.org nothing you've said seems to contradict to what I've said, no? :)

The really interesting question (and the one I am not smart enough to formally answer) is in what space does it do its interpolation. My layman understanding that all the recent advancements are thanks to the fact that the new architectures are able to coax the math to learn in a higher-level space than just the examples seen. So yeah, it does apply learned patterns to examples that fit them.

Problems begin when there is no known pattern that fits the task, which is exactly what innovation and creativity usually deal with :)