Hi
After compiling and building the jars of XGBoost 1.3.0-SNAPSHOT I am getting the below error. I didn’t get this error when I was using XGBoost 1.0.
Error:
Exception in thread “main” org.apache.spark.SparkException: No main class set in JAR; please specify one with --class
My env:
Centos 7
Spark version 2.4.3
Scala version 2.11.12
os.environ[‘PYSPARK_SUBMIT_ARGS’] = ‘–jars /path/dmlc/xgboost4j-spark_2.11/1.0.0-SNAPSHOT/xgboost4j-spark_2.11-1.0.0-SNAPSHOT.jar,/path/dmlc/xgboost4j_2.11/1.0.0-SNAPSHOT/xgboost4j_2.11-1.0.0-SNAPSHOT.jar pyspark-shell’
The only thing I changed in my python script from using XGBoost version to another is the ‘PYSPARK_SUBMIT_ARGS’ below. Any idea what could be wrong with these jars?
Thanks in advance!