Xgboost4j-spark 1.0.x availability

Hi all,

we follow the documentation here to use xgboost on spark :
https://xgboost.readthedocs.io/en/latest/jvm/xgboost4j_spark_tutorial.html#refer-to-xgboost4j-spark-dependency

the last version of the component is 1.0.2 but the last available version of xgboost4j-spark on maven central is the 0.9.0 :

https://search.maven.org/artifact/ml.dmlc/xgboost4j-spark/0.90/jar

is it possible to publish the new versions on maven central ?

Thanks

@CodingCat Can you help with this?

is there an update on this?

any new info.
still no version greater than 0.9 on maven.
If this is not manageable can you provide jar files which can be imported from github directly ?

thanks

Hi everyone:

We now host XGBoost4J JAR packages in our own Maven repository.

XGBoost4J 1.0.0 is available from our Release repository:

<repository>
  <id>XGBoost4J Release Repo</id>
  <name>XGBoost4J Release Repo</name>
  <url>https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/release/</url>
</repository>

SNAPSHOTs are available from our Snapshot repository:

<repository>
  <id>XGBoost4J Snapshot Repo</id>
  <name>XGBoost4J Snapshot Repo</name>
  <url>https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/snapshot/</url>
</repository>

See https://xgboost.readthedocs.io/en/release_1.0.0/jvm/index.html#installation-from-maven-repository for instructions for adding XGBoost4J to your application.

followed the instructions with:

<dependency>
		<groupId>ml.dmlc</groupId>
		<artifactId>xgboost4j_${scala.binary.version}</artifactId>
		<version>1.0.0</version>
	</dependency>
	<dependency>
		<groupId>ml.dmlc</groupId>
		<artifactId>xgboost4j-spark_${scala.binary.version}</artifactId>
		<version>1.0.0</version>
	</dependency>

and scala.binary.version = 2.11

ide gives message: Could not find artifact ml.dmlc:xgboost4j_2.11:pom:1.0.0 in XGBoost4J Release Repo (https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/release/)

any ideas, cheers sven

Right now XGBoost4J is compiled with Scala 2.12. You can check list of available artifacts at
https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/list.html.

Is it possible to upgrade to Scala 2.12? Or should we also compile XGBoost4J with Scala 2.11 too?

well, I would have to install another instance of spark. If it is not of a big problem from you side I would appreciate a 2.11 version.

cheers sven

@sven We’ve uploaded artifacts with Scala 2.11: https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/list.html?prefix=release/ml/dmlc/.

thanks a lot!

unfortunately I wasn’t able to automatically pull the files with Maven. Got a file not found error but I pulled the jar files manually. I was able to run my program with version 1.0.0.

I still have performance issues cpus workload at 10 to 15 % programm takes forever to calculate. When working in a Windows environment with c++ libs workload 100% and calculation time around 5 min. I posted this in another message already.

Thanks Sven

1.0.0 is now up in Maven Central as well.

1 Like