0 votes

Due to the volume of our data, we regularly switch to writing to a new index, with a simple incremental: my_index_1, my_index_2, etc... And we have many of them. Elasticsearch API allows use of a pattern for querying, i.e. my_index_*.

Dataiku is happy connecting to a specific index, But when I try this on a working Dataiku connection the index pattren like this Dataiku refuses to save it...

What to do?

asked by
I had same problem while I was writing article https://topwritingreviews.com/how_to_choose I spent mush time but, all in all, I solved it thanks to the reply below.

1 Answer

0 votes

Hello,

You can achieve this by creating an index alias which uses the wildcard magic to catch the indices you want. This follows the official ElasticSearch doc: https://www.elastic.co/guide/en/elasticsearch/reference/5.2/indices-aliases.html

POST /_aliases
{
    "actions" : [
        { "add" : { "index" : "test*", "alias" : "all_test_indices" } }
    ]
}

Then you will reference this index alias from the settings of the dataset within DSS.

Cheers,

Alex

answered by
930 questions
957 answers
958 comments
1,808 users