A few-shot prompt with five good examples costs nothing to build and can match a fine-tuned model's quality on many tasks. The question is when fine-tuning starts paying for itself.
The trade
A long few-shot prompt costs tokens on every single request — at high volume, that recurring cost outgrows the one-time cost of fine-tuning plus a shorter production prompt. At low volume, the reverse is true.
- Low request volume, task changes often: keep prompting, iterate the examples.
- High request volume, stable task: fine-tune once, then run a short prompt against the tuned model.
- Need behaviour the base model structurally can't follow no matter how you prompt it: fine-tuning is the only real option.
Estimate the crossover with your own numbers before committing engineering time to either path. See LLM cost control and token budgets.
— Pranjul Rathour, GenAI Engineer from Kanpur, India. Open to GenAI roles, hackathon judging, mentorship sessions and guest talks at any campus: pranjulrathour41@gmail.com.