How Banks Protect Customer Data When Using AI
Banks use artificial intelligence to help with tasks such as fraud detection, customer service and document review, but those systems may encounter sensitive information. Protecting customer data requires controls across the whole AI lifecycle: deciding what data may be used, limiting access, testing vendors and models, monitoring use, and preparing for incidents. The steps below describe a practical governance approach for a bank or financial institution; exact obligations depend on location and the service involved.
What You’ll Need
- A named business owner and accountable privacy, security, legal, compliance and model-risk contacts.
- An inventory of AI tools, use cases, data sources, vendors, data flows and system connections.
- Current data-classification, access-control, retention, incident-response and third-party-risk processes.
- A secure test environment and documented approval process before staff or customers use an AI system.
Step-by-Step
- Define the use case and its boundaries. Write down what the AI is meant to do, who will use it, what decisions it may influence, and what it must not do. Distinguish internal assistance, such as summarising public policy, from uses involving account records, identity documents, payment activity or credit decisions. Assign an owner who can pause the system and identify a human reviewer for consequential outputs. Do not let a general-purpose chatbot become an unapproved route for handling customer information.
- Map and classify the data. Trace information from its source through prompts, files, model providers, connected tools, logs, backups and outputs. Label data according to the bank’s classification scheme, including personal, financial, authentication and confidential business information. Identify data about customers, employees and other people, as well as combinations that could identify someone even after obvious identifiers are removed. Record where processing occurs and which parties can access it.
- Minimise data before it reaches a model. Use only the fields needed for the specific task. Replace names, account numbers and other direct identifiers with tokens or synthetic values when the task does not require the real values. Redaction and pseudonymisation reduce exposure but are not the same as anonymisation; linked details may still identify a person. Avoid pasting live customer records into public or unapproved AI services. For testing, use synthetic or carefully controlled, de-identified data and check that it cannot readily be re-linked.
- Approve the provider and contract before connecting data. Perform security, privacy, resilience and financial-crime risk reviews appropriate to the service. Confirm in writing what the provider does with prompts and outputs, whether data is retained or used to train models, how deletion works, where processing takes place, and which subprocessors are involved. Agree on breach notification, audit evidence, access controls, service continuity and secure return or deletion at termination. A provider’s statement that data is “secure” is not a substitute for checking these details.
- Put technical access controls in place. Use bank-managed accounts, single sign-on where available, multifactor authentication, role-based permissions and least-privilege access. Restrict connectors to the minimum folders, databases and actions needed. Separate development, testing and production; protect API credentials in an approved secrets manager rather than code or prompts. Encrypt data in transit and at rest using the bank’s established standards, and prevent users from changing security settings without approval.
- Control what the model can reveal or do. Set rules for prompt and output handling, and test for unintended disclosure, prompt injection, insecure retrieval and excessive access by connected tools. Treat documents and messages supplied to a model as untrusted input: they may contain instructions designed to override safeguards. Limit the model’s ability to send messages, move funds, change account details or make decisions. Require verified, explicit human approval for high-impact actions, and do not rely on a model’s confident tone as evidence that an answer is correct.
- Test privacy, security and model behaviour before launch. Use representative scenarios, including unusual and adversarial inputs. Check whether the system exposes data across customers or sessions, retains information unexpectedly, produces sensitive details in responses, or behaves differently for relevant groups. Review accuracy and fairness where outputs could affect access to financial services. Document findings, fixes, residual risks and approval. If testing identifies a serious exposure or uncontrolled action, block launch until the issue is addressed and retested.
- Train users and define safe handling rules. Give employees concise instructions on approved tools, permitted data, prohibited inputs, output verification and reporting suspected disclosures. Explain that a generated summary or recommendation may be wrong or incomplete. Provide a secure way to ask for help rather than encouraging staff to copy sensitive material into a convenient but unapproved tool. Keep training current as systems, data access and intended uses change.
- Monitor, retain and review proportionately. Log access and security-relevant activity, such as administrative changes, connector use and suspected policy violations, while avoiding unnecessary collection of sensitive prompt content. Set retention periods for prompts, outputs and logs; apply deletion rules to the provider and connected storage where supported. Monitor for unusual access, data leakage and changes in model or vendor behaviour. Reassess the use case when data sources, model versions, integrations or business decisions change.
- Prepare to contain and recover from an incident. Make the AI service part of the bank’s incident-response plan. Define who can disable a connector, revoke credentials, suspend user access, preserve relevant evidence and contact the provider. If customer data may have been exposed, follow the institution’s established security, privacy and communications procedures, including applicable notification requirements. After containment, identify the cause, correct access or configuration weaknesses, and obtain approval before restoring service.
Common Mistakes
- Assuming that data is private because a tool requires a login or describes itself as enterprise-ready.
- Sending full records when a narrow excerpt, masked fields or synthetic example would do.
- Relying on anonymisation without checking whether details can be linked back to a customer.
- Giving an AI assistant broad access to email, shared drives or account systems “for convenience.”
- Allowing generated decisions to affect customers without review, testing, traceability or a way to appeal.
- Keeping prompts and outputs indefinitely, or logging sensitive content without a clear operational need.
Tips
- Start with low-risk tasks using public or synthetic data, then expand only after documented review.
- Use a simple data-flow diagram to show where information goes, who handles it and how it is removed.
- Make the safest option the easiest: provide approved tools, clear examples and a quick reporting route.
- Recheck permissions and vendor terms periodically, not only when the system is first purchased.
- Keep a named human accountable for outputs and decisions, even when most of the workflow is automated.
Troubleshooting
A user entered customer information into an unapproved tool: Ask them to stop using it for that data, preserve relevant details without spreading the information further, and report the event through the bank’s incident process. Security and privacy teams should assess what was submitted, whether the provider retained it, and whether containment or notification is required. Do not assume that deleting a chat removes provider backups or logs.
The provider cannot explain retention or training use: Do not connect sensitive data until the terms and technical behaviour are clear. Request written answers and involve procurement, privacy and security reviewers. If the provider cannot meet the bank’s requirements, choose a different service or limit use to non-sensitive information.
The model returns another customer’s information or an unexpected sensitive detail: Disable the affected feature or connector, restrict access and escalate promptly. Preserve evidence under the incident plan, investigate data sources, session boundaries and retrieval permissions, then test the fix with adversarial cases before re-enabling it.
Staff find safeguards block legitimate work: Review the workflow with users and control owners. Adjust permissions or data minimisation only through formal review; do not bypass controls by switching to personal accounts or copying records elsewhere.
Frequently Asked Questions
Can banks use public AI tools with customer data?
Only if the tool and use are explicitly approved under the bank’s policies and contractual, privacy and security controls. Staff should not assume a public tool is suitable for confidential information.
Does removing a customer’s name make data anonymous?
No. Account details, dates, locations or combinations of attributes may still identify someone. Treat masked or pseudonymised records as sensitive unless a qualified review confirms otherwise.
Should AI outputs be used to make customer decisions automatically?
That depends on the use, its risks and applicable rules. High-impact decisions need appropriate validation, oversight, traceability and a process for handling errors; a model’s output should not be treated as inherently reliable.
What should a bank check before using an AI vendor?
Review data use and retention, training practices, subprocessors, processing locations, security controls, incident notification, deletion, audit evidence and continuity arrangements.
How often should AI systems be reviewed?
Set a risk-based schedule and review sooner when the model, provider, data, integrations, permissions or intended use changes, or when monitoring reveals a problem.
What is the first step after a suspected data leak?
Use the bank’s incident-response channel immediately. The responsible teams can contain access, assess the exposure, preserve evidence and determine required follow-up under applicable procedures.
Related
Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.