Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hi everyone,
I have a quick question:
I am importing datasets from snowflake, in a proper flow i.e., source -> warehouse -> data mart.
1) can either create them again in dataiku (double work) OR is there a way that this whole staging process goes in a proper sequential manner within the dataiku?
2) In this whole flow i want to add a few data quality checks such as checking for nulls, mismatching of IDs from one stage to another and duplications based on a few keys.
How could I enable it here in dataiku?
Metrics and Checks is what you want to use. Have a read:
https://knowledge.dataiku.com/latest/mlops-o16n/automation/concept-metrics-checks.html
Metrics and Checks is what you want to use. Have a read:
https://knowledge.dataiku.com/latest/mlops-o16n/automation/concept-metrics-checks.html
Yes, I used them but I do have a doubt and would appreciate your assistance Metrics and Checks - Dataiku Community