The Audit Phase: Mapping Manual Data Entry in Candidate Screening
A 51-200 person insurance firm in Switzerland with no AI in production yet faces a specific problem: manual data entry in candidate screening, claims intake, and policy administration consumes 15-20 hours per week across three teams. The EU AI Act, which entered into force in August 2024, classifies candidate screening as a high-risk use case under Article 6(2), meaning you cannot simply deploy an AI model and walk away. You need a human-in-the-loop design, audit logs, and a measured baseline before you scale.
The audit phase maps every step of the candidate screening workflow: resume ingestion, data extraction, classification against role requirements, drafting of initial assessments, and routing to a human reviewer. For a mid-size firm, this typically reveals that 60-80% of the time is spent on repetitive data entry and formatting, not on judgment. The audit output is a prioritized roadmap showing which workflow yields the highest ROI in the first 4-6 weeks.
The key constraint is that the firm has no AI in production yet. This means the pilot must establish the baseline: cycle time per candidate, error rate on data entry, and time-to-first-response. Without this baseline, you cannot measure whether the automation actually works. The audit phase is not optional; it is the foundation for every subsequent decision.
Building the Pilot: OpenAI API and Slack Integration
The pilot uses the OpenAI API for drafting and classification tasks. For candidate screening, the model extracts structured data from resumes, classifies candidates against role requirements, and drafts an initial assessment. The orchestration layer plugs into the firm’s existing ATS via API, so the AI does not replace the system of record. Instead, it reduces manual data entry by 60-80% while keeping the human in the loop for final decisions.
Integration with Slack or Microsoft Teams is critical for adoption. A recruiter receives a Slack message with the AI-drafted assessment and a one-click approve/reject button. This eliminates context switching and keeps the approval trail in a searchable channel. For a 51-200 person firm, this is the difference between a tool that gets used and one that sits in a dashboard nobody opens.
The architecture is deliberately model-agnostic. If data residency rules change or the firm later needs to process health data, the orchestration layer stays the same while the model switches to an open-weight model on the client’s own hardware. This flexibility is not a nice-to-have; it is a requirement for a Swiss firm operating under the Federal Act on Data Protection (FADP) and the EU AI Act simultaneously.
EU AI Act Compliance: Human Oversight and Audit Logs
The EU AI Act requires you to document the AI system’s purpose, data sources, and human oversight mechanisms. For candidate screening, Article 14 mandates human oversight: the AI drafts, but a person approves. This is not a suggestion; it is a legal obligation. The firm must maintain a log of every AI-drafted assessment and the human’s decision, stored for at least 6 months and accessible to regulators on request.
The pilot ships with a measured before/after baseline. Week 1 covers the process audit and baseline measurement. Weeks 2-3 build and test the automation with human-in-the-loop approval. Week 4 runs the pilot in production and measures cycle time and error rate against the baseline. Typical results show a 40-60% reduction in cycle time and a 30-50% drop in data entry errors for structured workflows.
The compliance documentation is not a separate project; it is built into the pilot from day one. The audit trail, the human oversight log, and the baseline metrics are all part of the deliverable. This means the firm can demonstrate compliance to regulators without a separate documentation effort after the pilot ends.
The 4-Week Timeline: Audit, Build, Measure
The 4-week timeline is fixed-scope. Week 1: process audit and baseline measurement. The audit covers the candidate screening workflow end-to-end, identifying where manual data entry occurs and measuring cycle time and error rates. The output is a prioritized roadmap showing which steps to automate first.
Weeks 2-3: build and test. The orchestration layer is configured to plug into the firm’s ATS via API. The OpenAI API is integrated for drafting and classification. The Slack or Microsoft Teams integration is tested with a small group of recruiters. The human-in-the-loop approval flow is validated: the AI drafts, the recruiter reviews, and the decision is logged.
Week 4: production pilot and measurement. The workflow runs in production for one week. The firm measures cycle time per candidate, error rate on data entry, and time-to-first-response against the baseline. The deliverable is a before/after report with concrete numbers, not a qualitative summary. This report is the basis for the rollout decision and the managed operation pricing.
Rollout and Managed Operation: What Comes After the Pilot
The pilot is not the end; it is the proof point. After 4 weeks, the firm has a measured baseline, a working automation, and a compliance trail. The next step is rollout: extending the automation to other workflows, such as claims data entry or policy document extraction. The roadmap from the audit phase sequences these by ROI, starting with the workflow that has the clearest baseline and the least regulatory complexity.
Managed operation is the ongoing service: monitoring the workflow, handling model updates, and maintaining the compliance documentation. For a 51-200 person firm, this is typically a monthly retainer of EUR 2,000-4,000, depending on the number of workflows and the volume of data processed. The retainer covers model monitoring, drift detection, and regulatory updates.
The key lesson from the pilot is that the audit phase is not optional. Without a measured baseline, you cannot prove the automation works. Without a human-in-the-loop design, you cannot comply with the EU AI Act. Without a model-agnostic architecture, you cannot adapt to changing data residency rules. The 4-week pilot establishes all three, and the rollout builds on them.
Leave a Reply