Access partitions

lisa811
Level 2
Access partitions

Hello,



I don't get how to "access" the different partitions dataiku created. I've got the dataset partions (see picture) which is divided by in my case station_uuid, but in the resulting dataset this column is missing. It also looks like there are different folders created. How can I access the partitions separately?



 



Thanks



 







 



 



 



0 Kudos
7 Replies
jereze
Community Manager
Community Manager

Hi,



When you open and see a dataset, you can configure the sampling to display only one partition.




  • On a dataset explore, click "Configure sample"

  • In "Use partitions", choose "select partitions"

  • In "partitions", select or enter the value of the partition you want to explore

Jeremy, Product Manager at Dataiku
0 Kudos
lisa811
Level 2
Author
Thanks a lot!
One more question: Now I would like to run a recipe on all of the partitions (clean forecast recipe). A colleague of yours recommended a variable. So I created a variable called uuid_list, which contains all the partitions separated by a "/". But I don't get how to use this now (see picture with the error above). Is there any other solution which helps me to apply the recipe to each of the partitions?
Thanks
0 Kudos
lisa811
Level 2
Author
Sorry the picture was missing
0 Kudos
jereze
Community Manager
Community Manager
Variable expansion works when using the Build/Train steps in scenarios, not in recipes.
Jeremy, Product Manager at Dataiku
0 Kudos
lisa811
Level 2
Author
Ok so it's not possible to apply a recipe to all partitions simultaneously?
0 Kudos
jereze
Community Manager
Community Manager
You have two ways to do it today:

1) You list the partitions in the "Recipe run options" (without using a variable). Note that your browser will remember the previously entered value.
2) You build your flow/recipes using a scenario (and you can use a manual trigger).

I noted your interest in the variable expansion system in the "Recipe run options".
Jeremy, Product Manager at Dataiku
0 Kudos
lisa811
Level 2
Author
Thanks!
0 Kudos