Policy-aware customer support instruction set with consistent answer structure
A client support team used a general-purpose AI to draft replies, but different employees used different prompts and important policy boundaries were not consistently carried into each draft.
Starting problem
Some drafts were concise while others were overly long. Refund wording varied, missing information was not always requested and the AI could make commitments the approved policy did not support.
Constraints
- AI drafts needed to distinguish known facts from missing information.
- Policy-sensitive topics required explicit source boundaries and escalation.
- The instruction had to be reusable by multiple team members.
- Output structure had to remain predictable without sounding robotic.
A→Z implementation
- Collect examples and target behaviorReviewed good/bad drafts, common categories, tone requirements and wording that must or must not appear.
- Design instruction hierarchySeparated role, objective, allowed context, policy rules, clarification behavior, tone and response format into a clear priority structure.
- Define category-specific rulesCreated compact handling blocks for delivery, returns, account questions, complaints and unsupported topics.
- Build output structureStandardized greeting, answer, missing-information request, next action and escalation language where appropriate.
- Create evaluation setTested routine questions, insufficient context, conflicting instructions, complaints and policy edge cases.
- Version and hand overDelivered a baseline instruction, a change-log method and a small retest suite for future edits.
Artifacts delivered
Acceptance criteria
- Replies followed the intended structure across main support categories.
- Missing information triggered clarification instead of invention.
- Policy-sensitive cases respected the defined boundaries.
- Team members could reuse the same instruction without rebuilding it for each ticket.