Skip to content
This repository has been archived by the owner on Sep 1, 2022. It is now read-only.

Compilation error #10

Open
mmeasic opened this issue May 10, 2021 · 0 comments
Open

Compilation error #10

mmeasic opened this issue May 10, 2021 · 0 comments

Comments

@mmeasic
Copy link

mmeasic commented May 10, 2021

[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-core_2.11 ---
[INFO] Using zinc server for incremental compilation
[warn] Pruning sources from previous analysis, due to incompatible CompileSetup.
[info] Compiling 494 Scala sources and 81 Java sources to /opt/spark/core/target/scala-2.11/classes...
[warn] /opt/spark/core/src/main/scala/org/apache/spark/BarrierTaskContext.scala:161: method isRunningLocally in class TaskContext is deprecated: Local execution was removed, so this always returns false
[warn]   override def isRunningLocally(): Boolean = taskContext.isRunningLocally()
[warn]                                                          ^
[warn] /opt/spark/core/src/main/scala/org/apache/spark/api/r/RBackend.scala:102: method childGroup in class ServerBootstrap is deprecated: see corresponding Javadoc for more information.
[warn]     if (bootstrap != null && bootstrap.childGroup() != null) {
[warn]                                        ^
[warn] /opt/spark/core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala:160: method getAllStatistics in object FileSystem is deprecated: see corresponding Javadoc for more information.
[warn]     val f = () => FileSystem.getAllStatistics.asScala.map(_.getThreadStatistics.getBytesRead).sum
[warn]                              ^
[warn] /opt/spark/core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala:191: method getAllStatistics in object FileSystem is deprecated: see corresponding Javadoc for more information.
[warn]     val threadStats = FileSystem.getAllStatistics.asScala.map(_.getThreadStatistics)
[warn]                                  ^
[warn] /opt/spark/core/src/main/scala/org/apache/spark/executor/ExecutorSource.scala:36: method getAllStatistics in object FileSystem is deprecated: see corresponding Javadoc for more information.
[warn]     FileSystem.getAllStatistics.asScala.find(s => s.getScheme.equals(scheme))
[warn]                ^
[warn] /opt/spark/core/src/main/scala/org/apache/spark/scheduler/StageInfo.scala:59: value attemptId in class StageInfo is deprecated: Use attemptNumber instead
[warn]   def attemptNumber(): Int = attemptId
[warn]                              ^
[warn] /opt/spark/core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala:492: trait AccumulableParam in package spark is deprecated: use AccumulatorV2
[warn]     param: org.apache.spark.AccumulableParam[R, T]) extends AccumulatorV2[T, R] {
[warn]                             ^
[warn] 7 warnings found
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 2.4.5:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [ 23.994 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 17.504 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 12.695 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 13.518 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 23.190 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  6.671 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 22.075 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 27.601 s]
[INFO] Spark Project Core ................................. FAILURE [01:26 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 30.914 s]
[INFO] Spark Project GraphX ............................... SKIPPED
[INFO] Spark Project Streaming ............................ SKIPPED
[INFO] Spark Project Catalyst ............................. SKIPPED
[INFO] Spark Project SQL .................................. SKIPPED
[INFO] Spark Project ML Library ........................... SKIPPED
[INFO] Spark Project Tools ................................ SUCCESS [ 16.075 s]
[INFO] Spark Project Hive ................................. SKIPPED
[INFO] Spark Project REPL ................................. SKIPPED
[INFO] Spark Project Hive Thrift Server ................... SKIPPED
[INFO] Spark Project Assembly ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
[INFO] Spark Avro ......................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:38 min (Wall Clock)
[INFO] Finished at: 2021-05-10T12:13:21Z
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hadoop-2.8" could not be activated because it does not exist.
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-core_2.11: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.: CompileFailed -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :spark-core_2.11
ERROR: 1
make: *** [build] Error 1

I am getting this error.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant