@argv_minus_one @HeckinChonker @leontheloner @prefec2 @nixCraft
These data points are meaningless without knowing the type of project and what type of changes they made to gauge how represented the tasks are in the training data.

LLMs are also a moving target. People who were saying LLMs completely changed the way they develop (they always use the verb "code" fsr) a year ago were either full of BS, so bad at dev they couldn't program almost at all or were doing boilerplate-heavy stuff. 3/n