Capital One DataProfiler
ID dataprofiler
detector
DataProfiler is an open source Python library from Capital One that profiles datasets and detects sensitive data. Its data labeler is a character-level neural model that predicts an entity label for each cell of structured data, and the profiler aggregates these predictions into a label for the column. The default structured labeler has 23 labels, such as EMAIL_ADDRESS, CREDIT_CARD, SSN, IPV4 and US_STATE; the list is in the label_mapping.json resource of the structured model and on the data labeling page of the docs.
- Website
- https://capitalone.github.io/DataProfiler/data_labeling.html
- Supported types
- 17
Supported semantic types
| ID | Name | Categories | Countries | Description |
|---|---|---|---|---|
| address | Address (physical location) PII | common, pii, geo | global | Geographic address, commonly consist of postindex, country, area, town, street and building |
| bankaccount | Bank account | finances | global | A bank account is a financial account maintained by a bank or other financial institution in which the financial transactions between... |
| bankcard | Bank card (credit/debit card) PII | pii, finances | global | A bank card is typically a plastic card issued by a bank to its clients that performs one or more of a number of services that relate to... |
| date | Date | datetime | global | Calendar date. The regexp covers the ISO 8601 extended form YYYY-MM-DD; other notations, such as DD.MM.YYYY, are patterns of this datatype. |
| datetime | Date and time | datetime | global | Date and time of day. The regexp covers the ISO 8601 extended form YYYY-MM-DDThh:mm[:ss[.fff]] with an optional time zone (Z or an... |
| driver_license | Driver's license number (universal) PII draft | pii, persons | global | Number of a driving licence, the document that a public authority issues to allow a person to drive motor vehicles. Each country or... |
| Email address PII | common, internet, pii | global | Address of an electronic mailbox in the form local-part@domain, defined in section 3.4.1 of RFC 5322. The local part names the mailbox,... | |
| ipv4 | IPv4 address PII | internet, pii | global | 32-bit address of Internet Protocol version 4 (RFC 791), written in dotted-decimal notation as four numbers from 0 to 255, such as... |
| ipv6 | IPv6 address PII | internet, pii | global | 128-bit address of Internet Protocol version 6, written as eight groups of up to four hexadecimal digits separated by colons (RFC 4291,... |
| mac_address | MAC address (Media Access Control) PII | internet, identifiers, pii | global | 48-bit hardware address (EUI-48) of a network interface in Ethernet, Wi-Fi, Bluetooth and other IEEE 802 networks, used to deliver... |
| person_fullname | Person fullname PII draft | persons, pii | global | Full name of the person as combination of last, first, and sometimes middle name |
| phone | Phone number PII | pii, common, telecom | global | Telephone number in standard format (RFC3966), without 'tel:' prefix |
| time | Time draft | datetime | global | Time of the day, like 12:00 or 10PM or 11:05 or 18:01:27 |
| url | Uniform Resource Locator (URL) | common, internet | global | Address of a resource on a network that also says how to retrieve it: a scheme such as https, a host, an optional port, a path, a query... |
| usssn | US Social Security Number PII | pii, persons | US | In the United States, a Social Security number (SSN) is a nine-digit number issued to U.S. citizens, permanent residents, and temporary... |
| usstate | US State draft | geo | US | Name or code of US State |
| uuid | Universally unique identifier (UUID) | identifiers | global | 128-bit identifier that systems generate without a central registry, defined by RFC 9562 (2024), which replaced RFC 4122. Microsoft... |
Use this record
- JSON: API v1 · legacy shape
- Improve it: edit
data/tools/detectors/dataprofiler.yamlon GitHub