ThisCalculator

Everyday

Shadow Data: What It Is & How to Minimize Damage

Updated · Standard formula, shown below

Shadow data refers to information that is stored, processed, or transmitted outside of an organization’s official IT systems and oversight. It is the data version of shadow IT: when employees use unsanctioned cloud storage, personal email, or unapproved apps for work, the data they create and share becomes shadow data. This article explains what shadow data is, why it is risky, and how to minimize the damage it can cause.

Background: The Rise of Shadow Data

Shadow data has grown with the adoption of cloud services and bring-your-own-device (BYOD) policies. Employees often choose tools that are easy to use and free, such as personal Dropbox accounts, Google Drive, or messaging apps, without going through IT approval. According to a 2022 survey by the data security firm Next DLP, 80% of employees admitted to using unsanctioned apps for work. This behavior creates data that is invisible to security teams, making it a blind spot for compliance and data protection.

The term “shadow” is used because the data exists in the dark, outside the purview of IT. It is not necessarily malicious; most employees do it to be more productive. However, the lack of oversight means that sensitive information can be exposed, lost, or stolen without the organization knowing.

How Shadow Data Works

Shadow data is created whenever a user moves work-related information to a system not managed by the organization. Examples include:

  • Emailing a spreadsheet with customer names to a personal Gmail account to work from home.
  • Using a personal USB drive to store project files.
  • Sharing a file via a public link on a personal cloud account.
  • Using a personal phone to access work email without a mobile device management (MDM) profile.

Once data leaves the corporate perimeter, it is no longer protected by enterprise security controls like encryption, access controls, and monitoring. It can be accessed by anyone who has the link or the password, and it is often stored in locations that do not meet the organization’s compliance requirements.

Risks and Damage of Shadow Data

The primary risks of shadow data are:

  • Data breaches: Unprotected data is easier to steal. A personal cloud account with a weak password can be compromised, exposing customer data or trade secrets.
  • Compliance violations: Regulations like GDPR, HIPAA, and PCI-DSS require organizations to know where personal data is stored and to protect it. Shadow data can lead to fines and legal action.
  • Loss of control: IT cannot manage, archive, or delete data it does not know about. This makes it impossible to enforce data retention policies.
  • Reputation damage: A breach involving shadow data can erode customer trust and harm the brand.

For example, in 2020, a major bank was fined $150 million for failing to supervise employees’ use of personal devices and messaging apps, which resulted in records being destroyed and not preserved. This illustrates the real-world consequences of shadow data.

How to Minimize Damage

Minimizing damage from shadow data requires a combination of technical controls, policy, and user behavior change. Here are the key steps:

  1. Discover and inventory: Use data loss prevention (DLP) tools and cloud access security brokers (CASBs) to identify where data is stored. Scan for personal cloud accounts, USB devices, and unapproved apps.
  2. Classify data: Tag data based on sensitivity (e.g., public, internal, confidential, restricted). This helps prioritize protection efforts.
  3. Implement policies: Create clear acceptable-use policies that define what is allowed and what is not. Communicate them regularly.
  4. Provide sanctioned alternatives: Offer approved tools that are as easy to use as the unsanctioned ones. If employees use a personal cloud because the corporate one is slow, fix the speed issue.
  5. Enforce technical controls: Use DLP to block or encrypt sensitive data leaving the network. Use MDM to manage personal devices that access corporate data.
  6. Monitor and respond: Continuously monitor for new shadow data instances. When found, remediate by moving the data to a sanctioned location or deleting it.
  7. Train users: Educate employees about the risks and provide simple guidelines for handling data.

Common Problems and Misconceptions

One common misconception is that shadow data is only about cloud storage. In reality, it includes any data outside IT control, including on personal devices, email, and even paper documents. Another misconception is that blocking all unsanctioned apps is the solution. In practice, this can backfire, as employees may find even more hidden ways to share data, making it harder to track.

Another problem is that shadow data is often invisible to traditional security tools. Firewalls and antivirus do not see data that is being uploaded to a personal cloud via HTTPS. This is why specialized tools like CASBs are needed.

Comparison: Shadow Data vs. Shadow IT

Shadow IT refers to any hardware, software, or service used without IT approval. Shadow data is the data that flows through those unsanctioned resources. While shadow IT is a broader concept, shadow data is specifically about the information itself. For example, using a personal Dropbox account is shadow IT; the files stored there are shadow data. Both are risks, but shadow data is often the more critical concern because it directly involves sensitive information.

Safety and Best Practices

To keep shadow data safe, organizations should:

  • Encrypt data both in transit and at rest, even when it is in shadow locations, if possible.
  • Use multi-factor authentication (MFA) on all accounts that may contain corporate data.
  • Regularly audit access to sensitive data and revoke access when employees leave.
  • Implement a data retention policy that includes shadow data discovery and deletion.

It is also important to remember that shadow data is not always a security incident. Sometimes it is just an inconvenience. The goal is to bring it back under control without disrupting productivity.

Frequently Asked Questions

What is the difference between shadow data and dark data?

Dark data is data that an organization collects but does not use for any purpose, such as old logs or unused sensor data. It is still under the organization’s control. Shadow data is data that is outside the organization’s control, often because it is on personal devices or unsanctioned apps.

How can I find shadow data in my organization?

You can start by reviewing network logs for uploads to personal cloud services, using DLP tools to scan for sensitive data leaving the network, and conducting user surveys to understand what tools employees are using. CASBs can also help identify shadow cloud apps.

Is shadow data always a security risk?

Not always, but it is a risk because it is unmanaged. Even if the data is not sensitive, it may be subject to compliance requirements or may become a liability if it is lost. The risk depends on the data’s sensitivity and the security of the location where it is stored.

What is the best tool to prevent shadow data?

No single tool prevents shadow data. A combination of DLP, CASBs, MDM, and user training is most effective. Start with discovery and classification, then implement controls based on the risks you find.

Can shadow data be legal?

Yes, shadow data can be legal, but it may violate company policy or regulatory requirements. For example, storing customer data on a personal cloud may be illegal under GDPR if the cloud provider does not meet EU data protection standards. Always check your organization’s policies and applicable laws.

Related

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.