Coming soon: We’re working on a brand new, revamped Community experience. Want to receive updates? Sign up now!

0 votes

My dataiku recipes are taking too long to run because of the absence of indexes in the  parent datasets. How do i add indexing in the output data so that the next recipe in the flow can take advantage of the indexing. I need help urgently. Thanks in advance

by

1 Answer

0 votes

Hi akuma, 

Should you need indexes on your tables, go under the dataset in question and follow these steps:

Go to Settings > Advanced. There you will find pre and post write statements. As an example in the pre-write statement you could drop the index and post-write create it again. This needs to follow the specific SQL syntax of your database.

So for postgres it would look like:

Pre-write statements:

DROP INDEX IF EXISTS some_index;

Post-write statements:

CREATE INDEX some_index ON "${projectKey}_table_name"(column);

 

by
Thank you. I will try using this.
1,337 questions
1,362 answers
1,556 comments
11,912 users

©Dataiku 2012-2018 - Privacy Policy