This seems a bit silly even if you think AI is a massive fraudulent waste of resources. People have spent decades using search engines to research and plan out murders. I get the all-encompassing surveillance state wants that and all other potential wrong-think blocked and/or reported with an eye to censoring false positives and hampering the operation of these services for consumers rather than risking even a small chance someone can write their way around these blocks with clever phrasing.
The hallucination stuff I admit is definitely something they should be held to account for but it may not be possible to stop that entirely so much as limit its frequency. The US and especially places like Florida represent a deeply broken, atomized society so the problem is deeper than chatgpt. Facebook has been harboring and spreading conspiracy theory nonsense for decades without being held to account because it buoys reactionary conservative politics.
Let me guess: in exchange for a suspended sentence he will be 4x as hawkish and make 2x as many appearances on media demanding blood for the national security state.