In my perception¹, ML differs from a brain by operating on words in form of tokens, while the human brain works by associating a concrete piece of information or thing with another, with the path in between being formed at some points, but crucially, being editable more or less easily and flexibly by retraining. And that's the points, humans learn on a fundamental level. Dropping the prod DB means that my brain will form a hard association between the action of writing 'drop database' and fear, which in turn triggers deeper thoughts about wth I'm doing. LLMs see "conflict at line 1, 12", and for some reason one possible path of tokens to generate can be a drop command. And as the underlying model data does not change, they don't learn.

On how living being's speech centres work, idk.

¹The perception of an acidhead. So don't trust me.