javaapache-sparkadoptopenjdkopenj9

Does Spark run with OpenJ9 and Java 8?


Is Spark functional for use with Java 8 + OpenJ9?

I found a pull request for version 3.0.0 but it was not very clear to me the consequences of running without this pull request. I am currently using version 2.3.0.

https://github.com/apache/spark/pull/24308

https://issues.apache.org/jira/browse/SPARK-27397


Solution

  • So far as I know, there's no functional problem. The pull request simply allows the SizeEstimator to correctly determine whether an OpenJ9 JVM is using compressed references. Correctly determining that compressed references are used "just" provides a performance boost.