What version of Scala does Hortonwork HDP 2.1 support?
I'm building Scalding job using Scala 2.10.4. Its successfully creating the job. But when I run the job in my Hortonworks it throwing the following exception.
According to some answers, this issue happens due to the conflicting scala version.
Can you please explain me this problem? I searched for a scala version in my Hortonworks I can't find it. Am I doing anything wrong ?
The stacktrace at the bottom is showing that your job throws in HadoopUtils.getRootQueue where you try to execute .get on an Option instance, that happens to be a None. So I don't think this is a version problem, rather you should either use .getOrElse or pattern match on the option, and handle the None case appropriately.
Also, you can write a Scalding unit test to catch these errors early before you submit the job to the cluster.
- Where is the documentation for scala.language.postfixOps?
- Chronomorphisms in Scala
- Remove all records which are duplicate in spark dataframe
- Running Scala from a script using terminal
- Karate-Gatling: Requests with query parameter in reports are not getting aggregated
- Ternary conditional operator in Scala
- Compiler as a service in Java
- Quill can't find case class property
- forming list of columns after groupByKey or groupBy
- Why is a `val` inside an `object` not automatically final?
- convert Rdd to dataframe
- Equivalent of Scala View in JavaScript
- How do I remove trailing elements in a Scala collection?
- Java compile speed vs Scala compile speed
- Adaptation of argument list by inserting () has been deprecated
- Reading Avro File in Spark
- Shuffle a list of integers with Java 8 Streams API
- What is the === (triple-equals) operator in Scala Koans?
- Expanding dataframe column into multiple columns
- Reactive streams (monix) operator combination for buffering for a timespan with overlapping elements
- Scala logging line numbers don't match using slf4s/slf4j?
- What are the available sbt new templates?
- getting the value of a key in a map in Scala
- Scala Type Mismatch Error when creating a Map
- How to split parquet files into many partitions in Spark?
- ExecutionContext issue in Akka Http Server
- Get field from Apache Spark Row which is Wrapped array as a Seq into a List using Scala
- What is the order of the scala compiler phases?
- Scala Akka HTTP Actor Class protocol Type Mismatch Error
- Convert Easting Northing Coordinates to Latitude and Longitude in Scala/Spark with EPSG Coordinate Transformation