Data Quality
"Quality or quantity, Don't tell me they're the same"
- Song by Bad Religion
What is data Quality?
Maintaining the quality of data flowing into a model can be challenging due to upstream data changes and the increasing pace of data proliferation as organizations scale.
Why monitor data quality?
Data quality monitors enable teams to quickly catch when features, predictions, or actuals data don't conform with what is expected.
Pre-configured data quality monitoring policies
| Type | Description |
|---|---|
| Missing values | Missing values on a feature level on a segment level |
| Out-of-Range | Anomaly in % of outliers on a feature level (numeric only) |
| New values | Anomaly in % of new values on a feature level (categorical only) |
| Fixed value | Detect features that are constant on the entire set level |
Updated about 2 years ago