You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on May 14, 2020. It is now read-only.
I posted as a comment to this issue on a previously closed issue. Basically, still having a build issue for the 1.0.0-M01 branch. Is there a solution to this? My output is below.
cutor - Finished task 0.0 in stage 106.0 (TID 105). 1000 bytes result sent to driver
16:58:07.296 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 106.0 (TID 105) in 87 ms on localhost (1/1)
16:58:07.296 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 106.0, whose tasks have all completed, from pool
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 106 (map at ClassifierUtil.java:42) finished in 0.088 s
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set()
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103, Stage 107)
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set()
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List(Stage 107)
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 107: List()
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101), which is now runnable
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(2752) called with curMem=5161632, maxMem=997699092
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 stored as values in memory (estimated size 2.7 KB, free 946.6 MB)
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101)
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 107.0 with 1 tasks
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-2] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 107.0 (TID 106, localhost, PROCESS_LOCAL, 937 bytes)
16:58:07.299 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 107.0 (TID 106)
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.305 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 107.0 (TID 106). 1000 bytes result sent to driver
16:58:07.305 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 107.0 (TID 106) in 6 ms on localhost (1/1)
16:58:07.305 [Result resolver thread-2] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 107.0, whose tasks have all completed, from pool
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 107 (combineByKey at BinaryClassificationMetrics.scala:101) finished in 0.006 s
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set()
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103)
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set()
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List()
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106), which is now runnable
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(3152) called with curMem=5164384, maxMem=997699092
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 stored as values in memory (estimated size 3.1 KB, free 946.6 MB)
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106)
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 103.0 with 1 tasks
16:58:07.307 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 103.0 (TID 107, localhost, PROCESS_LOCAL, 948 bytes)
16:58:07.307 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 103.0 (TID 107)
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.320 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 103.0 (TID 107). 991 bytes result sent to driver
16:58:07.321 [Result resolver thread-3] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 103.0 (TID 107) in 15 ms on localhost (1/1)
16:58:07.321 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 103 (collect at BinaryClassificationMetrics.scala:110) finished in 0.015 s
16:58:07.321 [Result resolver thread-3] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 103.0, whose tasks have all completed, from pool
16:58:07.321 [main] INFO org.apache.spark.SparkContext - Job finished: collect at BinaryClassificationMetrics.scala:110, took 0.284472139 s
16:58:07.323 [main] INFO o.a.s.m.e.BinaryClassificationMetrics - Total counts: {numPos: 31, numNeg: 43}
16:58:07.339 [main] INFO org.apache.spark.SparkContext - Starting job: runJob at SlidingRDD.scala:74
16:58:07.341 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 1 is 137 bytes
16:58:07.343 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 0 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 3 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 2 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 104 (runJob at SlidingRDD.scala:74) with 2 output partitions (allowLocal=true)
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 108(runJob at SlidingRDD.scala:74)
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 112)
16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List()
16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54), which has no missing parents
16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(4968) called with curMem=5167536, maxMem=997699092
16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 stored as values in memory (estimated size 4.9 KB, free 946.5 MB)
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 2 missing tasks from Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54)
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 108.0 with 2 tasks
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 108.0 (TID 108, localhost, PROCESS_LOCAL, 1057 bytes)
16:58:07.354 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 108.0 (TID 109, localhost, PROCESS_LOCAL, 1401 bytes)
16:58:07.354 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 108.0 (TID 109)
16:58:07.355 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 108.0 (TID 109). 723 bytes result sent to driver
16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 108.0 (TID 108)
16:58:07.356 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 108.0 (TID 109) in 4 ms on localhost (1/2)
16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.CacheManager - Partition rdd_215_0 not found, computing it
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.361 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(6232) called with curMem=5172504, maxMem=997699092
16:58:07.362 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 stored as values in memory (estimated size 6.1 KB, free 946.5 MB)
16:58:07.363 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.storage.BlockManagerInfo - Added rdd_215_0 in memory on 172.29.85.226:33829 (size: 6.1 KB, free: 946.8 MB)
16:58:07.363 [Executor task launch worker-1] INFO o.a.spark.storage.BlockManagerMaster - Updated info of block rdd_215_0
16:58:07.364 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 108.0 (TID 108). 1533 bytes result sent to driver
16:58:07.364 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 108.0 (TID 108) in 12 ms on localhost (2/2)
16:58:07.364 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 108.0, whose tasks have all completed, from pool
16:58:07.365 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 108 (runJob at SlidingRDD.scala:74) finished in 0.011 s
16:58:07.365 [main] INFO org.apache.spark.SparkContext - Job finished: runJob at SlidingRDD.scala:74, took 0.025972716 s
16:58:07.366 [main] INFO org.apache.spark.SparkContext - Starting job: aggregate at AreaUnderCurve.scala:45
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 105 (aggregate at AreaUnderCurve.scala:45) with 3 output partitions (allowLocal=false)
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 113(aggregate at AreaUnderCurve.scala:45)
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 117)
16:58:07.368 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List()
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47), which has no missing parents
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(5216) called with curMem=5178736, maxMem=997699092
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 stored as values in memory (estimated size 5.1 KB, free 946.5 MB)
16:58:07.370 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 3 missing tasks from Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 113.0 with 3 tasks
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 113.0 (TID 110, localhost, PROCESS_LOCAL, 1805 bytes)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 113.0 (TID 111, localhost, PROCESS_LOCAL, 1558 bytes)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 113.0 (TID 112, localhost, ANY, 1599 bytes)
16:58:07.371 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 113.0 (TID 111)
16:58:07.371 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 113.0 (TID 110)
16:58:07.374 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 113.0 (TID 110). 625 bytes result sent to driver
16:58:07.376 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 113.0 (TID 111). 625 bytes result sent to driver
16:58:07.377 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 113.0 (TID 112)
16:58:07.378 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 113.0 (TID 110) in 7 ms on localhost (1/3)
16:58:07.379 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 113.0 (TID 111) in 8 ms on localhost (2/3)
16:58:07.379 [Executor task launch worker-2] INFO o.apache.spark.storage.BlockManager - Found block rdd_215_0 locally
16:58:07.380 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 113.0 (TID 112). 1733 bytes result sent to driver
16:58:07.380 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 113.0 (TID 112) in 9 ms on localhost (3/3)
16:58:07.380 [Result resolver thread-0] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 113.0, whose tasks have all completed, from pool
16:58:07.380 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.DAGScheduler - Stage 113 (aggregate at AreaUnderCurve.scala:45) finished in 0.009 s
16:58:07.380 [main] INFO org.apache.spark.SparkContext - Job finished: aggregate at AreaUnderCurve.scala:45, took 0.013970632 s
Area under ROC = 0.6766691672918231
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.882 sec
Running org.graphify.core.api.extraction.FeaturesTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.008 sec <<< FAILURE!
Running org.graphify.core.api.selection.FeatureSelectorTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.034 sec <<< FAILURE!
Running org.graphify.core.kernel.impl.manager.NodeManagerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
Running org.graphify.core.kernel.impl.util.GraphManagerTest
{0} is known {1}
Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0 sec
Running org.graphify.core.kernel.impl.util.VectorUtilTest
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing broadcast 210
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_210
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 of size 5216 dropped from memory (free 992520356)
16:58:07.672 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 210
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 209
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_209
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 of size 4968 dropped from memory (free 992525324)
16:58:07.673 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 209
16:58:07.676 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 215
16:58:07.679 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_215_0
16:58:07.680 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 of size 6232 dropped from memory (free 992531556)
16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 215
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 208
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_208
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 of size 3152 dropped from memory (free 992534708)
16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 208
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 of size 2752 dropped from memory (free 992537460)
16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing broadcast 206
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_206
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO org.apache.spark.storage.MemoryStore - Block broadcast_206 of size 43128 dropped from memory (free 992580588)
16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 206
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 205
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_205
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_205 of size 4080 dropped from memory (free 992584668)
16:58:07.684 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 205
16:58:07.694 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 3
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 2
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 3
16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 2
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 1
16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 1
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 0
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 0
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_161 of size 45056 dropped from memory (free 992629724)
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 160
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_160
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_160 of size 38960 dropped from memory (free 992668684)
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 160
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_61 of size 45056 dropped from memory (free 992713740)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_60 of size 38960 dropped from memory (free 992752700)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing broadcast 1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_1 of size 4184 dropped from memory (free 992756884)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 3
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_3_0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_3_0 of size 4909480 dropped from memory (free 997666364)
16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 3
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_0 of size 32728 dropped from memory (free 997699092)
16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 0
[labels=[positive, negative], type=binary]
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.42 sec <<< FAILURE!
Results :
Tests in error:
testExtractFeatures(org.graphify.core.api.extraction.FeaturesTest): Node 0 not found
testCreateFeatureTarget(org.graphify.core.api.selection.FeatureSelectorTest): Node 0 not found
binaryClassificationTest(org.graphify.core.kernel.impl.util.VectorUtilTest)
Tests run: 13, Failures: 0, Errors: 3, Skipped: 3
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:26.963s
[INFO] Finished at: Tue Jun 16 16:58:08 EDT 2015
[INFO] Final Memory: 13M/215M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
[ERROR]
[ERROR] Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.MojoExecutor.executeForkedExecutions(MojoExecutor.java:365)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87)
at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:641)
at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:615)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 23 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
The text was updated successfully, but these errors were encountered:
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Hi Kenny,
I posted as a comment to this issue on a previously closed issue. Basically, still having a build issue for the 1.0.0-M01 branch. Is there a solution to this? My output is below.
mvn assembly:assembly -DdescriptorId=jar-with-dependencies --debug
cutor - Finished task 0.0 in stage 106.0 (TID 105). 1000 bytes result sent to driver
16:58:07.296 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 106.0 (TID 105) in 87 ms on localhost (1/1)
16:58:07.296 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 106.0, whose tasks have all completed, from pool
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 106 (map at ClassifierUtil.java:42) finished in 0.088 s
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set()
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103, Stage 107)
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set()
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List(Stage 107)
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 107: List()
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101), which is now runnable
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(2752) called with curMem=5161632, maxMem=997699092
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 stored as values in memory (estimated size 2.7 KB, free 946.6 MB)
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101)
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 107.0 with 1 tasks
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-2] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 107.0 (TID 106, localhost, PROCESS_LOCAL, 937 bytes)
16:58:07.299 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 107.0 (TID 106)
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.305 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 107.0 (TID 106). 1000 bytes result sent to driver
16:58:07.305 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 107.0 (TID 106) in 6 ms on localhost (1/1)
16:58:07.305 [Result resolver thread-2] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 107.0, whose tasks have all completed, from pool
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 107 (combineByKey at BinaryClassificationMetrics.scala:101) finished in 0.006 s
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set()
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103)
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set()
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List()
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106), which is now runnable
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(3152) called with curMem=5164384, maxMem=997699092
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 stored as values in memory (estimated size 3.1 KB, free 946.6 MB)
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106)
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 103.0 with 1 tasks
16:58:07.307 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 103.0 (TID 107, localhost, PROCESS_LOCAL, 948 bytes)
16:58:07.307 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 103.0 (TID 107)
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.320 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 103.0 (TID 107). 991 bytes result sent to driver
16:58:07.321 [Result resolver thread-3] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 103.0 (TID 107) in 15 ms on localhost (1/1)
16:58:07.321 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 103 (collect at BinaryClassificationMetrics.scala:110) finished in 0.015 s
16:58:07.321 [Result resolver thread-3] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 103.0, whose tasks have all completed, from pool
16:58:07.321 [main] INFO org.apache.spark.SparkContext - Job finished: collect at BinaryClassificationMetrics.scala:110, took 0.284472139 s
16:58:07.323 [main] INFO o.a.s.m.e.BinaryClassificationMetrics - Total counts: {numPos: 31, numNeg: 43}
16:58:07.339 [main] INFO org.apache.spark.SparkContext - Starting job: runJob at SlidingRDD.scala:74
16:58:07.341 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 1 is 137 bytes
16:58:07.343 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 0 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 3 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 2 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 104 (runJob at SlidingRDD.scala:74) with 2 output partitions (allowLocal=true)
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 108(runJob at SlidingRDD.scala:74)
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 112)
16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List()
16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54), which has no missing parents
16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(4968) called with curMem=5167536, maxMem=997699092
16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 stored as values in memory (estimated size 4.9 KB, free 946.5 MB)
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 2 missing tasks from Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54)
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 108.0 with 2 tasks
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 108.0 (TID 108, localhost, PROCESS_LOCAL, 1057 bytes)
16:58:07.354 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 108.0 (TID 109, localhost, PROCESS_LOCAL, 1401 bytes)
16:58:07.354 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 108.0 (TID 109)
16:58:07.355 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 108.0 (TID 109). 723 bytes result sent to driver
16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 108.0 (TID 108)
16:58:07.356 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 108.0 (TID 109) in 4 ms on localhost (1/2)
16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.CacheManager - Partition rdd_215_0 not found, computing it
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.361 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(6232) called with curMem=5172504, maxMem=997699092
16:58:07.362 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 stored as values in memory (estimated size 6.1 KB, free 946.5 MB)
16:58:07.363 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.storage.BlockManagerInfo - Added rdd_215_0 in memory on 172.29.85.226:33829 (size: 6.1 KB, free: 946.8 MB)
16:58:07.363 [Executor task launch worker-1] INFO o.a.spark.storage.BlockManagerMaster - Updated info of block rdd_215_0
16:58:07.364 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 108.0 (TID 108). 1533 bytes result sent to driver
16:58:07.364 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 108.0 (TID 108) in 12 ms on localhost (2/2)
16:58:07.364 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 108.0, whose tasks have all completed, from pool
16:58:07.365 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 108 (runJob at SlidingRDD.scala:74) finished in 0.011 s
16:58:07.365 [main] INFO org.apache.spark.SparkContext - Job finished: runJob at SlidingRDD.scala:74, took 0.025972716 s
16:58:07.366 [main] INFO org.apache.spark.SparkContext - Starting job: aggregate at AreaUnderCurve.scala:45
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 105 (aggregate at AreaUnderCurve.scala:45) with 3 output partitions (allowLocal=false)
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 113(aggregate at AreaUnderCurve.scala:45)
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 117)
16:58:07.368 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List()
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47), which has no missing parents
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(5216) called with curMem=5178736, maxMem=997699092
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 stored as values in memory (estimated size 5.1 KB, free 946.5 MB)
16:58:07.370 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 3 missing tasks from Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 113.0 with 3 tasks
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 113.0 (TID 110, localhost, PROCESS_LOCAL, 1805 bytes)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 113.0 (TID 111, localhost, PROCESS_LOCAL, 1558 bytes)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 113.0 (TID 112, localhost, ANY, 1599 bytes)
16:58:07.371 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 113.0 (TID 111)
16:58:07.371 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 113.0 (TID 110)
16:58:07.374 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 113.0 (TID 110). 625 bytes result sent to driver
16:58:07.376 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 113.0 (TID 111). 625 bytes result sent to driver
16:58:07.377 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 113.0 (TID 112)
16:58:07.378 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 113.0 (TID 110) in 7 ms on localhost (1/3)
16:58:07.379 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 113.0 (TID 111) in 8 ms on localhost (2/3)
16:58:07.379 [Executor task launch worker-2] INFO o.apache.spark.storage.BlockManager - Found block rdd_215_0 locally
16:58:07.380 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 113.0 (TID 112). 1733 bytes result sent to driver
16:58:07.380 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 113.0 (TID 112) in 9 ms on localhost (3/3)
16:58:07.380 [Result resolver thread-0] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 113.0, whose tasks have all completed, from pool
16:58:07.380 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.DAGScheduler - Stage 113 (aggregate at AreaUnderCurve.scala:45) finished in 0.009 s
16:58:07.380 [main] INFO org.apache.spark.SparkContext - Job finished: aggregate at AreaUnderCurve.scala:45, took 0.013970632 s
Area under ROC = 0.6766691672918231
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.882 sec
Running org.graphify.core.api.extraction.FeaturesTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.008 sec <<< FAILURE!
Running org.graphify.core.api.selection.FeatureSelectorTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.034 sec <<< FAILURE!
Running org.graphify.core.kernel.impl.manager.NodeManagerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
Running org.graphify.core.kernel.impl.util.GraphManagerTest
{0} is known {1}
Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0 sec
Running org.graphify.core.kernel.impl.util.VectorUtilTest
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing broadcast 210
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_210
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 of size 5216 dropped from memory (free 992520356)
16:58:07.672 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 210
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 209
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_209
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 of size 4968 dropped from memory (free 992525324)
16:58:07.673 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 209
16:58:07.676 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 215
16:58:07.679 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_215_0
16:58:07.680 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 of size 6232 dropped from memory (free 992531556)
16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 215
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 208
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_208
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 of size 3152 dropped from memory (free 992534708)
16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 208
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 of size 2752 dropped from memory (free 992537460)
16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing broadcast 206
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_206
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO org.apache.spark.storage.MemoryStore - Block broadcast_206 of size 43128 dropped from memory (free 992580588)
16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 206
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 205
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_205
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_205 of size 4080 dropped from memory (free 992584668)
16:58:07.684 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 205
16:58:07.694 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 3
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 2
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 3
16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 2
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 1
16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 1
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 0
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 0
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_161 of size 45056 dropped from memory (free 992629724)
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 160
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_160
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_160 of size 38960 dropped from memory (free 992668684)
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 160
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_61 of size 45056 dropped from memory (free 992713740)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_60 of size 38960 dropped from memory (free 992752700)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing broadcast 1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_1 of size 4184 dropped from memory (free 992756884)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 3
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_3_0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_3_0 of size 4909480 dropped from memory (free 997666364)
16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 3
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_0 of size 32728 dropped from memory (free 997699092)
16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 0
[labels=[positive, negative], type=binary]
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.42 sec <<< FAILURE!
Results :
Tests in error:
testExtractFeatures(org.graphify.core.api.extraction.FeaturesTest): Node 0 not found
testCreateFeatureTarget(org.graphify.core.api.selection.FeatureSelectorTest): Node 0 not found
binaryClassificationTest(org.graphify.core.kernel.impl.util.VectorUtilTest)
Tests run: 13, Failures: 0, Errors: 3, Skipped: 3
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:26.963s
[INFO] Finished at: Tue Jun 16 16:58:08 EDT 2015
[INFO] Final Memory: 13M/215M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
[ERROR]
[ERROR] Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.MojoExecutor.executeForkedExecutions(MojoExecutor.java:365)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87)
at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:641)
at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:615)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 23 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
The text was updated successfully, but these errors were encountered: