Coming soon: We’re working on a brand new, revamped Community experience. Want to receive updates? Sign up now!
Hi, I'm trying to run some spark code in scala in a Notebook.
When selecting Scala(Spark) in the notebook window, it shows me this modal : Kernel not found - I couldn't find a kernel matching Spark-Scala.
I think that Spark is configured as I can successfully use it in recipes.
From this page (https://doc.dataiku.com/dss/latest/spark/usage.html), I saw that The Spark-Scala notebook requires DSS to be run with Java 8.
So I ssh'ed to the EC2 machine running DSS and from the bottom of this page (https://doc.dataiku.com/dss/latest/installation/java_env.html) I see that we can set the DKUJAVABIN variable to point to the Java8 bin folder thanks to the command $ DKUJAVABIN=/usr/local/bin/java dataiku-dss-VERSION/installer.sh <INSTALLER_OPTIONS>
My question is : Is this the correct way to make the Scala-Spark notebook working ?
And : Will this command reinstall DSS and remove the work I've done in the previous installation ?
Thanks for your help !