Debugging

Lets debugging SampleProgram.scala from the spark console in Docube server

Using putty logon to the Docube server using your credentails



cd / and run the command ./opt/docube/spark-2.3.2-bin-hadoop2.7/bin/spark-shell –jars /opt/docube/spark-2.3.2-bin-hadoop2.7/jars/docube-spark-client-1.0-SNAPSHOT.jar to get the spark console



Lets import the packages, set the sqlContext



Lets get the Spark Development Token and update ctx

Lets update the input and output files