Tools

Capital One DataProfiler

ID dataprofiler

detector

DataProfiler is an open source Python library from Capital One that profiles datasets and detects sensitive data. Its data labeler is a character-level neural model that predicts an entity label for each cell of structured data, and the profiler aggregates these predictions into a label for the column. The default structured labeler has 23 labels, such as EMAIL_ADDRESS, CREDIT_CARD, SSN, IPV4 and US_STATE; the list is in the label_mapping.json resource of the structured model and on the data labeling page of the docs.

Website
https://capitalone.github.io/DataProfiler/data_labeling.html
Supported types
17

Supported semantic types

IDNameCategoriesCountriesDescription
address Address (physical location) PII common, pii, geo global Geographic address, commonly consist of postindex, country, area, town, street and building
bankaccount Bank account finances global A bank account is a financial account maintained by a bank or other financial institution in which the financial transactions between...
bankcard Bank card (credit/debit card) PII pii, finances global A bank card is typically a plastic card issued by a bank to its clients that performs one or more of a number of services that relate to...
date Date datetime global Calendar date. The regexp covers the ISO 8601 extended form YYYY-MM-DD; other notations, such as DD.MM.YYYY, are patterns of this datatype.
datetime Date and time datetime global Date and time of day. The regexp covers the ISO 8601 extended form YYYY-MM-DDThh:mm[:ss[.fff]] with an optional time zone (Z or an...
driver_license Driver's license number (universal) PII draft pii, persons global Number of a driving licence, the document that a public authority issues to allow a person to drive motor vehicles. Each country or...
email Email address PII common, internet, pii global Address of an electronic mailbox in the form local-part@domain, defined in section 3.4.1 of RFC 5322. The local part names the mailbox,...
ipv4 IPv4 address PII internet, pii global 32-bit address of Internet Protocol version 4 (RFC 791), written in dotted-decimal notation as four numbers from 0 to 255, such as...
ipv6 IPv6 address PII internet, pii global 128-bit address of Internet Protocol version 6, written as eight groups of up to four hexadecimal digits separated by colons (RFC 4291,...
mac_address MAC address (Media Access Control) PII internet, identifiers, pii global 48-bit hardware address (EUI-48) of a network interface in Ethernet, Wi-Fi, Bluetooth and other IEEE 802 networks, used to deliver...
person_fullname Person fullname PII draft persons, pii global Full name of the person as combination of last, first, and sometimes middle name
phone Phone number PII pii, common, telecom global Telephone number in standard format (RFC3966), without 'tel:' prefix
time Time draft datetime global Time of the day, like 12:00 or 10PM or 11:05 or 18:01:27
url Uniform Resource Locator (URL) common, internet global Address of a resource on a network that also says how to retrieve it: a scheme such as https, a host, an optional port, a path, a query...
usssn US Social Security Number PII pii, persons US In the United States, a Social Security number (SSN) is a nine-digit number issued to U.S. citizens, permanent residents, and temporary...
usstate US State draft geo US Name or code of US State
uuid Universally unique identifier (UUID) identifiers global 128-bit identifier that systems generate without a central registry, defined by RFC 9562 (2024), which replaced RFC 4122. Microsoft...

Use this record