apache-sparkibm-cloudhortonworks-data-platformanalytics-engine

Use local jar files in IBM Analytics Engine


I'm trying to falimiarise myself with IBM Analytics Engine. I've managed to create a service and run an example application. I now wish to see how one of my applications runs on it. For this I need two jars(which currently sit on my Mac). I tried to scp them to the jars folder in my Analytics Engine but got a permission denied. How can I use these?


Solution

  • I didn't have any trouble scp-ing into my home directory of my master node:

    scp hello-world.jar clsadmin@xxx-xxx-xxx-xxxxx.bi.services.us-south.bluemix.net:/home/wce/clsadmin/
    

    I was able to run using spark-submit:

    spark-submit --master yarn --deploy-mode cluster --class HelloWorld /home/wce/clsadmin/hello-world.jar
    

    Are you trying to copy into your home directory, or another directory?