Coding lends itself to long-horizon tasks. These tiny models simply don’t have the brains for this.
Coding also needs a large base of knowledge. Small models by definition don’t have this. Maybe if someone figures out how to make useful n-grams 285% of size instead of 28.5% of size…
Coding? No.
Coding lends itself to long-horizon tasks. These tiny models simply don’t have the brains for this.
Coding also needs a large base of knowledge. Small models by definition don’t have this. Maybe if someone figures out how to make useful n-grams 285% of size instead of 28.5% of size…