The Instruction Budget
Every always-loaded instruction competes for the model's attention. Keep only lines whose removal would cause mistakes; move everything else to where it loads when needed.
1 post
Every always-loaded instruction competes for the model's attention. Keep only lines whose removal would cause mistakes; move everything else to where it loads when needed.