Q & A
Governance & Security
Learn Dataiku DSS
Q & A
Ask a Question
Email or Username
I forgot my password
DSS HDInsights problems
hello, I was working in a HDInsights cluster where I have Dataiku DSS and whenever I try to run a hive query I get this error: "com.microsoft.azure.storage.blob.CloudBlob.startCopyFromBlob(Lcom/microsoft/azure/storage/blob/CloudBlob;Lcom/microsoft/azure/storage/AccessCondition;Lcom/microsoft/azure/storage/AccessCondition;Lcom/microsoft/azure/storage/blob/BlobRequestOptions;Lcom/microsoft/azure/storage/OperationContext;)Ljava/lang/String;"
Spark is runing very well, I am not sure, but it seemed to me that the problem arrises from within DSS infrastructure since I recieve the same problem when I run a DSS visual, Python/R recipies and tell them to create the new dataset as hdfs, with the visual recipies the problem goes away when I tell it to run in spark engine instead of DSS. I have gone around the problem with R and Python if I tell DSS to print the new table as a filesystem, but with hive I cannot do the same I even cannot use pig nor impala. have you got any idea why this is happening, should I change a parameter or do something else?
Any help will be greatly appreciated.
ps. if you need me to send you logs or something I will.
closed with the note:
closed with the note: found answer by reading the doc: I enter to read documentations and chenged my HDI settings and now it works perfectly... Also I noticed Impala does not work with HDI haha have a nice day :D (the easiest way is to do it as in the video of DSS with HSInsights put spark 1.6 (HDI 3.5) and it will do all the configuration, so you do not have to do the config by hand)
Aug 10, 2017
Aug 11, 2017
I am quite stupid... I enter to read documentations and chenged my HDI settings and now it works perfectly... Also I noticed Impala does not work with HDI haha have a nice day :D
Aug 11, 2017
to add a comment.
Most popular tags
Can changes in HDFS datasets be automatically tracked?
Problems after installing Impala
Dataiku on Azure VM, connect to HDInsight interactive query
Problem writing JSON data to "HDFS_managed" dataset storage
java.lang.nullpointerexception for any receipt
Welcome to Dataiku Answers, where you can ask questions and receive answers from other members of the community.
©Dataiku 2012-2018 -