0 votes
When I populate mnist dataset, I have to create each folder one by one, like creating folder 0, 1, 2, ...9, then upload files to each of these folders. I would like to know if there is easy way to populate dataset from the parent folder, which the sub folders have been well organized on my local disk.

1 Answer

0 votes
Are you trying to place a collection of files into a single DSS folder, or are you trying to nest DSS folders?

You can place any number of files (within reason) into a single DSS folder, and then create a single dataset from the folder.  You should ensure the schema for each file is identical thought.  As far as nesting DSS folders to mimic a files system structure, I am not sure if that is possible and have never tried.

A third method, although I have had mixed experiences with it, is to create folders in DSS that mirror my local folders, and then upload files folder by folder, then combine the folders in subsequent flow steps (Prepare/Stack/Python)
1,296 questions
1,324 answers
11,862 users

┬ęDataiku 2012-2018 - Privacy Policy