Can I use Python or Hive to in Dataiku to export data to a folder on a local machine at specific intervals?

Question

Hello,

I would like to export data from Dataiku tables to either an SQL database that is not hooked up to the Dataiku production instance or to folders on a local machine --and I would like to have said exports execute automatically throughout the day at specific intervals. Is this at all possible, what would be the best approach, and would you possibly have a sample code stream?

 

Thanks

 

- J

Answer 1

Hi,

It is possible to schedule actions in DSS using scenarios (https://doc.dataiku.com/dss/latest/scenarios/)

For the "export to folder on the local machine", you can directly use the "Export" recipe that writes to a managed folder, and rebuild the managed folder in your scenario. I am not sure exactly how you would envision exporting to the SQL database if it's not reachable from DSS, though.

Important note: scheduled scenarios are not available in the free edition of DSS.