Agency Operations12 min read

AI Chatbot Maintenance Retainers: What to Include Each Month

C
Chirps Editorial Team

Published 2026-08-31

The Chirps Editorial Team turns product experience, implementation research, and responsible AI guidance into practical playbooks for customer-facing teams.

Agency specialist monitoring and maintaining a client's AI chatbot

A chatbot maintenance retainer should pay for accountable operation: reviewing real conversations, correcting source gaps, testing customer actions, reporting verified outcomes, and managing approved changes. Charging every month for an untouched embed is not a durable service.

Customer questions, websites, policies, staff, product catalogs, and calendars change. Even a strong launch configuration can become stale. The retainer defines who notices change, who approves it, and how the system is tested afterward.

What a monthly retainer should include

WorkstreamMonthly workEvidence for the client
Conversation qualityReview a defined sample of unanswered, escalated, low-rated, and high-value sessionsFindings, examples, and approved actions
Knowledge healthUpdate approved pages or documents and resolve conflicting informationChange log with source owner
Search qualityCheck failed searches, broken links, product cards, and stale public resultsTest queries and corrected destinations
Conversion workflowsTest leads, bookings, dispatch alerts, and confirmationsTimestamped test records and recipients
ExperienceCheck mobile, dark mode, accessibility, close behavior, consent, and major browsersRegression checklist
OperationsReview permissions, connectors, notification owners, and known incidentsAccess review and incident notes
ReportingCompare agreed metrics with baseline and explain material changesConcise report with decisions, not vanity totals

Use a risk-based review cadence

Not every client needs the same frequency. A stable brochure site may need a monthly review; a changing store, seasonal service, or high-volume support workflow may need weekly checks. High-risk workflows may require approvals, monitoring, and controls beyond a standard agency retainer.

Weekly or automated checks

  • Notification delivery for critical lead, booking, or escalation routes.
  • Availability and timezone behavior for active booking workflows.
  • Broken installation, domain, authentication, or connector warnings.
  • Sudden increases in errors, unresolved questions, or failed customer actions.

Monthly review

  • Representative conversation sample and negative feedback themes.
  • Top intents, search misses, source gaps, and repeated escalations.
  • Lead and booking completion based on the agreed definitions.
  • Approved content changes and regression tests.
  • Named actions, owners, and due dates for the next period.

Quarterly governance review

  • Business goal, scope, prohibited topics, and human escalation boundaries.
  • User access, roles, connector permissions, credentials, and former staff.
  • Privacy notice, retention expectations, consent, and data minimization.
  • Whether the workflow still creates enough verified value to continue or expand.

The NIST AI Resource Center and the NIST Generative AI Profile are useful references for risk-aware monitoring and evaluation. Apply controls proportionately to the client's use case.

Report metrics the client can interpret

MetricDefine it before reportingAvoid
ConversationsWhat starts a session and which environments countPresenting raw opens as customer outcomes
Answered requestsHow the sample or classification determines a useful answerCalling every AI reply a resolution
Qualified leadsRequired fields and qualification ruleCounting test or incomplete submissions
BookingsCompleted confirmation and excluded cancellations/testsCounting calendar views as appointments
Human takeoverWhat triggers it and whether it was handledTreating all escalation as failure
SatisfactionCollection method, response count, and periodClaiming broad satisfaction from a tiny sample

Set boundaries before the first invoice

  • Number of assistants, sites, languages, and workflows covered.
  • Conversation sample size and reporting frequency.
  • Included content updates, configuration changes, and meetings.
  • Support channel, support hours, response target, and emergency definition.
  • Excluded development, integrations, migrations, copywriting, and compliance advice.
  • Usage charges, third-party costs, taxes, and approval for overages.
  • Change-request process for new journeys, connectors, voice numbers, or client entities.

Price these obligations with the white-label chatbot pricing framework. Put the boundaries into the proposal and statement of work, then confirm the operating owners during client onboarding.

A simple monthly meeting agenda

  1. Review incidents, broken actions, and urgent customer-impacting issues first.
  2. Explain what customers asked and where the assistant lacked sufficient information.
  3. Review leads, bookings, human handoffs, and satisfaction using agreed definitions.
  4. Approve knowledge and workflow changes with an owner for each source.
  5. Choose no more than a few prioritized improvements and define their tests.
  6. Record decisions, exclusions, and any work that requires a separate estimate.

When to recommend expansion

Expand only when the current workflow is stable and evidence supports the next use case. A client might add voice after the website assistant handles the same intents reliably, or add a connector after the team has documented permissions and approval requirements. New complexity should not be used to hide an unresolved foundation.

This article is general operational guidance. It does not create a service-level agreement and is not legal, security, accounting, or compliance advice.

Manage client assistants with evidence

Use Chirps conversations, analytics, knowledge controls, lead and booking records, notifications, and human takeover to run a measurable maintenance service.