Background: A 2,400-Person Payments Firm in the UAE
This case study is a composite drawn from patterns Forfis has observed across multiple engagements in Tier-1 markets. No named customer is represented. The details below reflect a recurring profile: a mid-to-large fintech or payments company in the UAE or Gulf region, operating under GDPR-equivalent data-protection rules, with a helpdesk that has outgrown manual triage.
The company in this scenario is a payments processor with roughly 2,400 employees, a mix of engineering, compliance, and customer-operations staff. Its product stack includes a core payment engine, a merchant portal, and a customer-facing helpdesk running on a commercial platform. The helpdesk handles 18,000 to 22,000 tickets per month, the majority of which are routine: failed-payment inquiries, settlement-delay questions, and document-request follow-ups. Senior operations staff spend an estimated 35 to 45 percent of their week reading, categorizing, and routing these tickets before any substantive work begins.
Challenge: Senior Staff Buried Under Routine Triage
The operations director set a clear constraint: senior staff were being consumed by work that did not require their judgment. A payment-failure ticket that follows the standard runbook in Confluence should not be read by a team lead with eight years of settlement experience. The pressure was not just efficiency; it was retention. Three senior operations managers had left in the preceding year, citing repetitive triage as a primary factor.
Compliance added a second constraint. The firm processes customer data subject to the UAE Data Protection Law (Federal Decree-Law No. 45 of 2021), which aligns closely with GDPR Articles 5, 28, and 30. Any AI system touching ticket content had to demonstrate data minimization, processor accountability, and a documented right-to-erasure path. The firm had already run two isolated pilots on document extraction for onboarding, but those pilots had not produced a measured baseline and had not moved to production. The operations team was skeptical of a third pilot unless the scope was narrow, the timeline was fixed, and the success criteria were written into the contract before a single line of code was written.
Approach: A Fixed-Scope Pilot on One Workflow
Forfis scoped the engagement as a fixed-scope, three-month pilot on a single workflow: ticket triage and routing for the payment-failure and settlement-delay categories. The architecture used the Anthropic Claude API for classification and summarization, with the model called from a lightweight service that read ticket content from the helpdesk’s REST API and wrote routing decisions back. The knowledge base lived in Confluence, queried through its search API to pull the relevant runbook for each ticket category.
The delivery model was managed AI operations from day one. Forfis handled the technical planning, the prompt engineering, the evaluation harness, and the integration work. The client’s operations team provided the labeled sample set (400 historical tickets with correct routing decisions) and the Confluence content owners. The human-in-the-loop boundary was explicit: the agent classified and routed, but any ticket flagged as involving a refund, a contract amendment, or a regulatory report was suppressed from auto-routing and escalated to a senior reviewer. Every model call was logged with a retention window matching the firm’s records-management policy, satisfying the processor-accountability requirement under the UAE law and GDPR Article 30.
Outcome: Measured Cycle-Time Reduction and Error-Rate Drop
The pilot ran for twelve weeks. The first two weeks were the process audit: Forfis mapped the top ten ticket intents, measured the current median cycle time (4.2 hours from ticket creation to first substantive response) and the current misrouting rate (11.3 percent on a 300-ticket sample). Weeks three through six built the triage agent and the evaluation harness. Weeks seven through twelve ran shadow mode: the agent drafted a routing decision, a human approved or overrode it, and the override was logged.
By week twelve, the agent’s classification accuracy on a held-out set of 200 tickets was 94.1 percent. The median cycle time for the two target categories dropped to 2.6 hours, a 38 percent reduction. The misrouting rate fell to 3.8 percent. Three senior operations managers reported spending roughly 12 to 15 hours per week less on initial triage, which they redirected to escalation handling and vendor-management work. The client extended the engagement to a managed-operations contract covering model monitoring, Confluence content review, and incident response at a fixed monthly fee. The pilot did not expand to fraud detection or chargeback handling; those remain separate engagements with their own baselines.
Lessons for Teams Running Isolated Pilots in Regulated Sectors
Five lessons from this engagement generalize to similar teams in regulated, high-volume operations:
-
Scope the pilot to one workflow, not a category. “Ticket triage” is too broad. “Triage and routing for payment-failure and settlement-delay tickets” is a contract. The narrower the scope, the more defensible the baseline and the faster the rollout decision.
-
Write the success criteria before the audit. The 94 percent accuracy threshold and the 30 percent cycle-time reduction were in the statement of work before Forfis touched the helpdesk API. Without that, the pilot becomes a demo, not a decision.
-
Keep the knowledge base in the tool the team already uses. Confluence was the source of truth for runbooks. Pulling from it via API meant the content owners did not need to learn a new system, and updates propagated without a retraining step.
-
Log every model call from day one. The compliance team asked for the audit trail in week four, not week twelve. Having it from week one turned a potential blocker into a non-issue.
-
Do not let the pilot absorb adjacent workflows. The operations team wanted fraud triage in week five. Holding the line kept the timeline realistic and the error-rate target achievable.
Leave a Reply