Xgboost4j-spark 1.0.x availability

Hi all,

we follow the documentation here to use xgboost on spark :
https://xgboost.readthedocs.io/en/latest/jvm/xgboost4j_spark_tutorial.html#refer-to-xgboost4j-spark-dependency

the last version of the component is 1.0.2 but the last available version of xgboost4j-spark on maven central is the 0.9.0 :

https://search.maven.org/artifact/ml.dmlc/xgboost4j-spark/0.90/jar

is it possible to publish the new versions on maven central ?

Thanks

@CodingCat Can you help with this?

is there an update on this?

any new info.
still no version greater than 0.9 on maven.
If this is not manageable can you provide jar files which can be imported from github directly ?

thanks

Hi everyone:

We now host XGBoost4J JAR packages in our own Maven repository.

XGBoost4J 1.0.0 is available from our Release repository:

<repository>
  <id>XGBoost4J Release Repo</id>
  <name>XGBoost4J Release Repo</name>
  <url>https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/release/</url>
</repository>

SNAPSHOTs are available from our Snapshot repository:

<repository>
  <id>XGBoost4J Snapshot Repo</id>
  <name>XGBoost4J Snapshot Repo</name>
  <url>https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/snapshot/</url>
</repository>

See https://xgboost.readthedocs.io/en/release_1.0.0/jvm/index.html#installation-from-maven-repository for instructions for adding XGBoost4J to your application.

followed the instructions with:

<dependency>
		<groupId>ml.dmlc</groupId>
		<artifactId>xgboost4j_${scala.binary.version}</artifactId>
		<version>1.0.0</version>
	</dependency>
	<dependency>
		<groupId>ml.dmlc</groupId>
		<artifactId>xgboost4j-spark_${scala.binary.version}</artifactId>
		<version>1.0.0</version>
	</dependency>

and scala.binary.version = 2.11

ide gives message: Could not find artifact ml.dmlc:xgboost4j_2.11:pom:1.0.0 in XGBoost4J Release Repo (https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/release/)

any ideas, cheers sven

Right now XGBoost4J is compiled with Scala 2.12. You can check list of available artifacts at
https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/list.html.

Is it possible to upgrade to Scala 2.12? Or should we also compile XGBoost4J with Scala 2.11 too?

well, I would have to install another instance of spark. If it is not of a big problem from you side I would appreciate a 2.11 version.

cheers sven

@sven We’ve uploaded artifacts with Scala 2.11: https://s3-us-west-2.amazonaws.com/xgboost-maven-repo/list.html?prefix=release/ml/dmlc/.

thanks a lot!

unfortunately I wasn’t able to automatically pull the files with Maven. Got a file not found error but I pulled the jar files manually. I was able to run my program with version 1.0.0.

I still have performance issues cpus workload at 10 to 15 % programm takes forever to calculate. When working in a Windows environment with c++ libs workload 100% and calculation time around 5 min. I posted this in another message already.

Thanks Sven

1.0.0 is now up in Maven Central as well.

1 Like

Hi,
new jars do not include xgboost4j.dll, old ones did include it (0.9 for example) - and I was able to run tests using it under windows.

Is there a reason for this?

thanks,
Ran.

"Windows not supported by published JARs

The published JARs from the Maven Central and GitHub currently only supports Linux and MacOS. Windows users should consider building XGBoost4J / XGBoost4J-Spark from the source"

https://xgboost.readthedocs.io/en/latest/jvm/index.html

Simply, we haven’t gotten around testing JARs for Windows target.