A sales rep pastes a client contract into ChatGPT to summarize it faster. A bookkeeper drops your Q3 financials into an AI tool to build a report. An employee uploads a customer list to get "marketing ideas." Nobody meant any harm — but the moment that data left your control, you lost the ability to say where it went, who else can see it, or whether it just became part of some model's training data.
I call this shadow AI — the same problem IT teams have fought for years with "shadow IT" (unapproved apps and file-sharing tools), except now it's happening inside a tool that looks and feels like a harmless typing assistant. And it's happening at almost every small business I visit, whether the owner knows it or not.
What "Shadow AI" Actually Means for a Small Business
It's not employees doing something malicious. It's employees trying to work faster, using whatever tool is fastest — a free AI chatbot in a browser tab, no company oversight, no idea what happens to the text they paste in. Client names, contract terms, payroll numbers, source code, internal strategy documents — all of it looks the same to an AI tool. It doesn't know what's sensitive. It just processes what it's given.
Why This Is Worse Than It Sounds
Three things make this riskier than the average "employee mistake":
- You often can't tell it happened. There's no ticket, no alert, no log entry most businesses ever look at. It just... happens, quietly, dozens of times a week.
- Free-tier AI tools may use your input to improve their models. Depending on the tool and the account type, information pasted in can be retained or used for training — meaning your client's contract terms could theoretically influence what the AI tells a future stranger.
- It breaks confidentiality agreements you've already signed. If you have an NDA with a client or a compliance obligation (HIPAA, financial data, legal privilege), pasting their information into a public AI tool can be a real breach — with real consequences — even though nobody clicked "share" or "send" in the traditional sense.
What Data Should Never Go Into a Public AI Tool
As a simple rule of thumb, treat public AI chatbots the way you'd treat a stranger sitting next to you on a plane who happens to be a great writer. Would you read them your client contract, your payroll spreadsheet, or your source code out loud? If not, don't paste it in. That covers:
- Client and customer personal information (names, addresses, SSNs, account numbers)
- Financial statements, payroll data, and banking details
- Contracts, NDAs, and anything covered by a confidentiality clause
- Source code or proprietary business processes
- Anything you'd be uncomfortable seeing on the front page of the local paper
A Simple AI Policy Beats a Total Ban
Banning AI tools outright rarely works — employees will use them anyway, just more quietly. A better approach is a short, plain-English policy: which tools are approved, what data is off-limits, and where employees should go for the "I want to use AI for X" conversation instead of guessing. Most businesses can write this in half a page. The goal isn't to slow people down — it's to make sure the fast way and the safe way are the same way.
How Copilot for Microsoft 365 Changes the Equation
This is exactly why we're seeing so much interest in Microsoft Copilot right now. Copilot runs inside your existing Microsoft 365 tenant, under your organization's existing security and compliance boundary — it doesn't send your data out to train a public model the way a free consumer chatbot does. That's a meaningfully different risk profile. But "safer than the free option" isn't the same as "safe by default" — Copilot still needs the right license tier, the right data-access permissions, and the right sensitivity labels configured before you turn it loose on your SharePoint and email. We cover exactly what to check in our Copilot licensing and security breakdown.
Not sure what your team is pasting into AI tools right now — or whether your Microsoft 365 setup is ready for Copilot? We'll help you find out.
Get a Free Security Assessment