Skip to content

forage-spark-java

View on GitHub


Initial setup in POM.xml

Add maven.compiler properties
Add Spark-core dependency

To test by running a class (usual parm passed as -Dexec.args=arg1,arg2...)

mvn compile exec:java -Dexec.mainClass=ForageTasks
mvn compile exec:java -Dexec.mainClass=ForageTasks -Dexec.args=-f='path to excel'

To test Spark application

jdk 1.8.0_212
mvn install or mvn package
spark-submit --class ForageTasks target/forage-java-tasks-1.0-SNAPSHOT-jar-with-dependencies.jar -f='path to excel' > output.log