AI confidently writes code that's completely wrong

The fix

Two patterns to break: (1) Always ask "how would you verify this works?" before accepting code. Forces the model to think about test cases. (2) If something feels off, paste the code back and ask "what would happen if X was actually empty/null/large?". Confident-wrong code usually has a single edge case the model didn't model.