Tools
Software that detects or uses semantic data types, with the registry types each one supports.
| Tool | Category | Supported types | Description |
|---|---|---|---|
| Alteryx Designer Cloud | other | 13 | Alteryx Designer Cloud, formerly Trifacta, is a cloud service for data preparation. It infers a data type for each column from the first rows of a sample,... |
| Amazon Macie | pii | 112 | Amazon Macie scans objects in Amazon S3 for sensitive data with managed data identifiers. They cover credentials and private keys, financial data such as... |
| Ataccama ONE | catalogs | 0 | Ataccama ONE classifies catalog items and attributes by assigning business glossary terms to them. Detection rules attached to a term decide when it... |
| Auctus | other | 9 | This project is a web crawler and search engine for datasets, specifically meant for data augmentation tasks in machine learning. It is able to find... |
| Auto-Type | detector | 83 | Auto-Type is a research system from Microsoft Research, published at SIGMOD 2018, that builds type-detection functions for rich semantic types. Given a type... |
| Amazon Comprehend | pii | 37 | Amazon Comprehend is an AWS natural language processing service. Its PII detection (the DetectPiiEntities API and asynchronous batch jobs) finds personal... |
| AWS Glue Sensitive Data Detection | pii | 199 | AWS Glue Sensitive Data Detection, used through the Detect PII transform in AWS Glue Studio or from ETL scripts, finds personal and other sensitive data in... |
| Azure AI Language PII detection | pii | 166 | Azure AI Language (now named Azure Language in Foundry Tools) has a PII detection API that uses NLP models to find personal data in text and conversation... |
| BigID | pii | 0 | BigID is a data security and privacy platform that discovers and classifies sensitive data in structured and unstructured data sources. It uses... |
| Collibra Data Classification | catalogs | 78 | Collibra suggests data classes for catalog columns with classification rules: regular expressions on column names or values, lists of values and data type... |
| csv-detective | detector | 41 | Python package by the data.gouv.fr team that detects what the columns of a tabular file (CSV, Excel, ODS, Parquet) contain. For each column it combines... |
| Databricks Unity Catalog data classification | pii | 83 | Data classification in Databricks Unity Catalog scans the tables of a catalog with an AI agent and tags columns with classes such as class.email_address,... |
| DataHub classification | catalogs | 15 | DataHub can classify table columns during ingestion and attach a glossary term for each detected info type. The built-in classifier comes from the... |
| Dataiku DSS | other | 16 | Dataiku DSS is a platform for data preparation, analytics and machine learning. Every column of a dataset has a meaning, which DSS infers from a sample of... |
| DataPrep | etl | 169 | DataPrep is an open-source Python library for data preparation from the SFU Database Group. Its clean module standardises and validates the values of a... |
| Capital One DataProfiler | detector | 17 | DataProfiler is an open source Python library from Capital One that profiles datasets and detects sensitive data. Its data labeler is a character-level... |
| detect-secrets | detector | 22 | detect-secrets is an open-source (Apache-2.0) secret scanner from Yelp, built to stop new secrets from entering a code base: it records known findings in a... |
| Doduo | detector | 30 | Doduo is a research model from Megagon Labs, published at SIGMOD 2022, that predicts the semantic type of every column of a table and the relation between... |
| FTA (Fast Text Analysis) | detector | 180 | Java library by Tim Segall that profiles a stream of values and infers its base type, format and semantic type, for example EMAIL, IDENTITY.VAT_FR or... |
| Gitleaks | detector | 48 | Open-source (MIT) secret scanner that finds hard-coded credentials, such as API keys, access tokens and private keys, in git history, directories and... |
| Google Data Studio | other | 14 | With Data Studio, you can easily report on data from a wide variety of sources, without programing. In just a few moments, you can connect to data sets such... |
| Google Cloud Sensitive Data Protection (DLP) | pii | 66 | Google Cloud Sensitive Data Protection, formerly Cloud DLP, inspects text, files, BigQuery and Cloud Storage with built-in infoType detectors: names,... |
| Great Expectations Semantic Types Expectations | other | 63 | A contributed package of custom expectations for Great Expectations, the Python data validation framework. Each expectation asserts that the values of a... |
| IBM Security Guardium Analyzer | pii | 34 | IBM Security Guardium Analyzer is a powerful service that can help you with this data security effort. Simple to use, Guardium Analyzer allows you to set up... |
| IBM Knowledge Catalog (IBM watsonx.data intelligence) | catalogs | 79 | IBM Knowledge Catalog, now part of IBM watsonx.data intelligence, assigns data classes to table columns when it profiles data assets. More than 150... |
| Informatica Cloud Data Governance and Catalog | catalogs | 0 | Informatica Cloud Data Governance and Catalog classifies columns and fields of scanned sources with data element classifications that are configured in... |
| Metabase | other | 14 | Metabase is a simple and powerful analytics tool which lets anyone learn and make decisions from their company s data no technical knowledge required. |
| metacrafter | detector | 502 | Python command line tool and python engine to label table fields and fields in data files. It could help to find meaningful data in your tables and data... |
| metacrafterpro | detector | 113 | Cloud web service based on Metacrafter open source (https://github.com/apicrafter/metacrafter) available for beta testing by request |
| Metadata Guardian | pii | 15 | Metadata Guardian is a Python package that provides an easy way to protect your data sources by searching its metadata. By searching with data rules, it... |
| Microsoft Purview Data Loss Prevention | pii | 223 | Microsoft Purview (formerly Microsoft 365 compliance) finds sensitive data in Microsoft 365, endpoints and connected sources with built-in sensitive... |
| Nightfall AI | pii | 125 | Nightfall is a cloud data loss prevention platform that scans SaaS applications, endpoints and API payloads for sensitive data. Its built-in detectors use... |
| OpenMetadata auto-classification | catalogs | 47 | OpenMetadata's auto-classification workflow samples table columns and tags them PII.Sensitive or PII.NonSensitive. It matches column names against regular... |
| Oracle Analytics Desktop | other | 13 | Oracle Analytics Desktop is a desktop application for preparing, exploring and visualizing data. When a dataset is created, it profiles each column and... |
| Oracle Data Safe | pii | 21 | Oracle Data Safe is a security service for Oracle databases. Its Data Discovery feature finds sensitive columns with sensitive types, each defined by... |
| PII Catcher | pii | 11 | PIICatcher is a scanner for PII and PHI information. It finds PII data in your databases and file systems and tracks critical data. |
| Microsoft Power BI | other | 11 | Microsoft Power BI is a business intelligence service with a desktop report editor. In Power BI Desktop the author sets a data category on a column, such as... |
| Microsoft Presidio | pii | 60 | Presidio (Origin from Latin praesidium protection, garrison) helps to ensure sensitive data is properly managed and governed. It provides fast... |
| python-stdnum | other | 228 | python-stdnum is an open source Python library with one module per standard number: national tax, VAT, company and personal identifiers, bank account and... |
| qddate | detector | 35 | Python library by Ivan Begtin that finds and parses dates written in many notations without being told the format. Version 1.1.0 has 151 date patterns, each... |
| Sato | detector | 30 | Sato is a research model from Megagon Labs, published at VLDB 2020, that predicts the semantic type of every column of a table. It extends the Sherlock... |
| scrubadub | pii | 7 | Remove personally identifiable information from free text. Sometimes we have additional metadata about the people we wish to anonymize. Other times we dont.... |
| Semgrep | detector | 28 | Semgrep is a static analysis engine that runs pattern rules over source code and plain text. Its public rule registry has secret rules under... |
| Sherlock | detector | 30 | Sherlock is a deep learning model from the MIT Media Lab that predicts the semantic type of a table column from its values, without using the column header.... |
| Snowflake sensitive data classification | pii | 169 | Sensitive data classification in Snowflake samples the columns of tables and assigns each column a native semantic category, such as EMAIL,... |
| Soda | other | 8 | Soda allows everyone on your data team to find, analyze, and resolve data issues. Our open-source tools and data observability platform bring everyone... |
| RedGate SQL Data catalog | catalogs | 20 | SQL Data Catalog helps you protect your business by providing a scalable and repeatable process for managing personally-identifiable information (PII), as... |
| Tableau | other | 23 | Tableau is a business intelligence and visual analytics platform. In Tableau Desktop a field can be given a geographic role, such as Airport, City,... |
| Talend (Qlik Talend Data Preparation, Data Catalog and Data Inventory) | etl | 80 | Talend, now part of Qlik, suggests a semantic type for each column of a dataset. The types live in Talend Dictionary Service and are shared by Data... |
| TruffleHog | detector | 46 | TruffleHog is an open-source (AGPL-3.0) secret scanner from Truffle Security that searches git history, file systems, cloud storage and other sources for... |
| Alteryx Woodwork | detector | 15 | Woodwork is an open source Python library from Alteryx that adds typing metadata to pandas DataFrames: a logical type and semantic tags for each column. It... |