One major issue with coding with an LLM is that they regularly make the kinds of mistakes that I'd see non-Computer Science Majors who had to take beginning programming classes for their majors make, but are unable to learn not to do that.

So it takes a while to debug when they get into a ridiculous state because the mistake they've made is so fundamental you're probably not looking for it.