Coming soon: We’re working on a brand new, revamped Community experience. Want to receive updates? Sign up now!

0 votes
I was wondering if there's any way to have project versioning in Dataiku.

For you to understand better I will try to explain our use case in more details. Usually our Dataiku projects has specific names which represents a clear purpose of what this model is for. So far we were not recalibrating our models (maybe that is an idea for the future) but usually new models are build anew from scratch and replaces the old ones. Maybe both of them are using at the same time for a while. The problem we face is that when we start a new model we want work on the same Dataiku project but that project contains the flow that was used to build the old model. We don't want to create another flow side by side because of several reasons: flow will look messy (imagine what we will have after creating not 2 but 5 models or even more), common dataset or folder names are already in use which is also inconvenient and maybe other reasons. At the same time we don't want to delete the old flow because we might need in the future. So basically we want to have an ability to switch between different flows (versions) in the same project. What would be the best ways to solve it?

I had couple ideas but I haven't tried to implement them from start to end. One idea was to use bundles. If I understand correctly we can download bundles which are as versions of a project and could be stored anywhere we want. Correct me if I am wrong and that is not possible. However, I don't like this option very much because switching between versions might be complicated and inconvenient. Other idea was to behave like in a typical "coding" project and use code version control (git) to make project versions. I believe that the best way to do this would be to create a remote repository in Dataiku (Github repo for example). Then push changes there and create a completely new branch and push this branch into Dataiku. In other words, just have different branches for different versions and be able to switch between them using git. Is that possible to do? Or maybe you can suggest any other option?

1 Answer

0 votes
A Customer Success Manager will get back to you by email with the different options and trade-offs.
1,337 questions
1,364 answers
11,916 users

©Dataiku 2012-2018 - Privacy Policy