Expectations
Last updated
Last updated
VDA's Expectation Books are designed to facilitate data quality assurance and validation. It empowers data analysts to define and run data quality tasks using expectations, ensuring that data meets predefined criteria and adheres to specific requirements. By setting and validating expectations, analysts can instill confidence in the data, leading to more reliable and trustworthy analytical outcomes.
Expectations are part of Workbooks within VDA . Navigate to workbooks tab and select "Expectation Book" .
Once selected provide a name and description for the expectation book and select a Datasource on which the expectation needs to run .A Expectation book is a collection of data expectations which can be grouped as per datasources or business use-cases .
Once a book is created click on the + button on the right bottom of the screen to create an expectation .
Select Templated or Custom
Expectations are of two types
Templated
Templated expectations are predefined criteria provided by VDA, commonly used across the data industry. These expectations cover a wide range of standard data quality checks and are frequently updated. They are stored in a public repository that auto-syncs, ensuring users always have access to the latest set of expectations. Details for templated expectations can be found in the next sections .
Custom
Custom expectations, on the other hand, are criteria created by organizations to meet specific needs when no relevant templated expectation is available. These allow organizations to define their own data quality rules tailored to their unique data requirements and quality standards.Templated expectations are created using templates once selected you will be redirected to create a expectation template .
If you have selected Templated, then from bottom panel select Template name
Enter the details like Database, Table, column(s) and expected values
Expectations form will change based on the template below is an example for a template for a expectation which expects column as not null .
Enter the details like Database, Table, column(s) and expected values
Expectation will get created
Now you can Preview your Expectation
