Details
-
Bug
-
Status: Closed
-
Normal
-
Resolution: Fixed
-
3.10.00
Description
1.[INFO] [talledLocalContainer] 17.02.2015 07:53:00 WARN [org.apache.spark.Logging$class.logWarning():71] Timed out while stopping the job generator (timeout = 5000)
--------------------------------------------------------------------------------
2.[INFO] [talledLocalContainer] 17.02.2015 15:25:33 WARN [org.apache.hadoop.util.NativeCodeLoader.<clinit>():62] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
--------------------------------------------------------------------------------------
[INFO] [talledLocalContainer] 17.02.2015 07:53:00 ERROR [org.apache.spark.Logging$class.logError():96] Could not submit checkpoint task to the thread pool executor
[INFO] [talledLocalContainer] java.util.concurrent.RejectedExecutionException: Task org.apache.spark.streaming.CheckpointWriter$CheckpointWriteHandler@3c2b9cab rejected from java.util.concurrent.ThreadPoolExecutor@6254faf6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
[INFO] [talledLocalContainer] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[INFO] [talledLocalContainer] at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[INFO] [talledLocalContainer] at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[INFO] [talledLocalContainer] at org.apache.spark.streaming.CheckpointWriter.write(Checkpoint.scala:188)
[INFO] [talledLocalContainer] at org.apache.spark.streaming.scheduler.JobGenerator.doCheckpoint(JobGenerator.scala:263)
[INFO] [talledLocalContainer] at org.apache.spark.streaming.scheduler.JobGenerator.org$apache$spark$streaming$scheduler$JobGenerator$$processEvent(JobGenerator.scala:167)
[INFO] [talledLocalContainer] at org.apache.spark.streaming.scheduler.JobGenerator$$anonfun$start$1$$anon$1$$anonfun$receive$1.applyOrElse(JobGenerator.scala:76)
[INFO] [talledLocalContainer] at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
[INFO] [talledLocalContainer] at org.apache.spark.streaming.scheduler.JobGenerator$$anonfun$start$1$$anon$1.aroundReceive(JobGenerator.scala:74)
[INFO] [talledLocalContainer] at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
[INFO] [talledLocalContainer] at akka.actor.ActorCell.invoke(ActorCell.scala:487)
[INFO] [talledLocalContainer] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
[INFO] [talledLocalContainer] at akka.dispatch.Mailbox.run(Mailbox.scala:220)
[INFO] [talledLocalContainer] at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:393)
[INFO] [talledLocalContainer] at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
[INFO] [talledLocalContainer] at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
[INFO] [talledLocalContainer] at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
[INFO] [talledLocalContainer] at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)