0 votes
I'm working with Datasets in Azure Blob storage. I see that Dataiku says writing to Avro format is available, but it's not an option on my output dataset (only CSV is). What do I need to do to get Avro writing enabled?
by
reopened by
I found the answer - I can export to Avro as desired by using the "Export" recipe.

Next question however... it seems that my Avro files do not retain column types - is this expected? Also, on _some_ datasets Dataiku errors due to Date column types but on others it doesn't - what might be causing this issue?

I do see the "Date known issue" (https://doc.dataiku.com/dss/latest/formats/avro.html#limitations-and-issues) but it appears that Avro 1.8 has been released with this fix - does DataIku not support 1.8 yet?

1 Answer

0 votes
Best answer
Hi,

Indeed you can use the Export feature on a dataset to export it to Avro. As you noted, we do not currently support DATE types on Avro, as Avro 1.8 has not been qualified at the moment. I have logged your request for consideration in our roadmap.

Best regards,

Alex
by
selected by
1,200 questions
1,229 answers
1,387 comments
11,760 users

┬ęDataiku 2012-2018 - Privacy Policy