Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
From a Python recipe, I am trying to write a dataframe from a SQL query that has a little over 13k rows. Using the following code, DSS is only writing 10k rows. How do I get the remaining rows?
DataWithSample_df = SampleActiveMem_df # SQL output that I've reviewed
# Write recipe outputs
DataWithSample = dataiku.Dataset("DataWithSample")
DataWithSample.write_schema_from_dataframe(DataWithSample_df)
for df in DataWithSample.iter_dataframes(chunksize=15000):
DataWithSample.write_from_dataframe(DataWithSample_df)
Solved: user error by misnaming a dataframe. My mistake
Solved: user error by misnaming a dataframe. My mistake
Thank you for sharing your solution with the Community @dharman!