#model regression

Newer Claude models (Opus 4.8 and Sonnet 5) generate malformed tool calls that include extra invented fields, causing tool call rejections in third-party coding harnesses like Pi, while older models did not exhibit this issue. This counterintuitive regression shows that reinforcement learning for specific tool schemas can degrade performance on other tools, posing reliability challenges for developers building agents that rely on consistent tool-use behavior. The malformed calls typically have the correct edit content but include made-up keys in the nested edits[] array, violating the schema. Armin Ronacher hypothesizes that newer models are overtrained on Claude Code's built-in edit tool format.