Dear G-d... [Redacted] is making me take an "AI" course for sunk-cost FOMO reasons... Half the "optimizations" they're talking about aren't optimizations at all. "Boilerplate" is either due to an insufficient level of abstraction, or can be written much more efficiently (and accurately...) via traditional code generation techniques. As for "expressing the problem as natural language", I don't think about the problem-space in natural language, so it's just as much (if not more) work to serialize it out as natural language as it is to just write the damned code...
And "implementing features": if you can accurately express what needs to be done such that a computer can do the rest, what's that called? Code. Congrats, you just made a shitty compiler that's both nondeterministic and with frequently wildly incorrect output...