Class org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSparkIntegrationTest

6

tests

0

failures

0

ignored

0.952s

duration

100%

successful

Tests

Test Duration Result
testBuiltInCollectors[0](insert_size_metrics_test.sam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.136s passed
testBuiltInCollectors[1](insert_size_metrics_test.bam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.316s passed
testBuiltInCollectors[2](insert_size_metrics_test.cram, /home/runner/work/gatk/gatk/src/test/resources/Homo_sapiens_assembly19_chr1_1M.fasta, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.256s passed
testCustomCollectorAPI[0](insert_size_metrics_test.sam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.035s passed
testCustomCollectorAPI[1](insert_size_metrics_test.bam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.115s passed
testCustomCollectorAPI[2](insert_size_metrics_test.cram, /home/runner/work/gatk/gatk/src/test/resources/Homo_sapiens_assembly19_chr1_1M.fasta, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.094s passed

Standard error

[May 19, 2025 at 7:00:23 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1679818752
[May 19, 2025 at 7:00:24 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1679818752
[May 19, 2025 at 7:00:24 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1679818752
19:00:24.576 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.576 INFO  CollectMultipleMetricsSpark - org.broadinstitute.hellbender.tools.spark.pipelines.metrics vUnavailable
19:00:24.576 INFO  CollectMultipleMetricsSpark - For support and documentation go to https://software.broadinstitute.org/gatk/
19:00:24.576 INFO  CollectMultipleMetricsSpark - Executing as runner@pkrvmf6wy0o8zjz on Linux v6.11.0-1014-azure amd64
19:00:24.576 INFO  CollectMultipleMetricsSpark - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10
19:00:24.576 INFO  CollectMultipleMetricsSpark - Start Date/Time: May 19, 2025 at 7:00:24 PM UTC
19:00:24.576 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.576 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.576 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.COMPRESSION_LEVEL : 2
19:00:24.576 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
19:00:24.576 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
19:00:24.576 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
19:00:24.576 INFO  CollectMultipleMetricsSpark - Deflater: IntelDeflater
19:00:24.576 INFO  CollectMultipleMetricsSpark - Inflater: IntelInflater
19:00:24.576 INFO  CollectMultipleMetricsSpark - GCS max retries/reopens: 20
19:00:24.576 INFO  CollectMultipleMetricsSpark - Requester pays: disabled
19:00:24.576 WARN  CollectMultipleMetricsSpark - 

?[1m?[31m   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

   Warning: CollectMultipleMetricsSpark is a BETA tool and is not yet ready for use in production

   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!?[0m


19:00:24.576 INFO  CollectMultipleMetricsSpark - Initializing engine
19:00:24.576 INFO  CollectMultipleMetricsSpark - Done initializing engine
19:00:24.577 INFO  CollectMultipleMetricsSpark - Spark verbosity set to INFO (see --spark-verbosity argument)
WARNING	2025-05-19 19:00:24	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
WARNING	2025-05-19 19:00:24	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
19:00:24.578 INFO  MemoryStore - Block broadcast_3408 stored as values in memory (estimated size 37.8 KiB, free 1906.2 MiB)
19:00:24.579 INFO  MemoryStore - Block broadcast_3408_piece0 stored as bytes in memory (estimated size 8.4 KiB, free 1906.2 MiB)
19:00:24.579 INFO  BlockManagerInfo - Added broadcast_3408_piece0 in memory on localhost:40133 (size: 8.4 KiB, free: 1917.5 MiB)
19:00:24.579 INFO  SparkContext - Created broadcast 3408 from broadcast at SamSource.java:78
19:00:24.580 INFO  MemoryStore - Block broadcast_3409 stored as values in memory (estimated size 306.3 KiB, free 1905.9 MiB)
19:00:24.586 INFO  MemoryStore - Block broadcast_3409_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1905.8 MiB)
19:00:24.586 INFO  BlockManagerInfo - Added broadcast_3409_piece0 in memory on localhost:40133 (size: 64.4 KiB, free: 1917.4 MiB)
19:00:24.586 INFO  SparkContext - Created broadcast 3409 from newAPIHadoopFile at SamSource.java:108
WARNING	2025-05-19 19:00:24	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
WARNING	2025-05-19 19:00:24	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
19:00:24.588 INFO  MemoryStore - Block broadcast_3410 stored as values in memory (estimated size 37.8 KiB, free 1905.8 MiB)
19:00:24.589 INFO  MemoryStore - Block broadcast_3410_piece0 stored as bytes in memory (estimated size 8.4 KiB, free 1905.8 MiB)
19:00:24.589 INFO  BlockManagerInfo - Added broadcast_3410_piece0 in memory on localhost:40133 (size: 8.4 KiB, free: 1917.4 MiB)
19:00:24.589 INFO  SparkContext - Created broadcast 3410 from broadcast at SamSource.java:78
19:00:24.590 INFO  MemoryStore - Block broadcast_3411 stored as values in memory (estimated size 306.3 KiB, free 1905.5 MiB)
19:00:24.596 INFO  MemoryStore - Block broadcast_3411_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1905.4 MiB)
19:00:24.596 INFO  BlockManagerInfo - Added broadcast_3411_piece0 in memory on localhost:40133 (size: 64.4 KiB, free: 1917.4 MiB)
19:00:24.596 INFO  SparkContext - Created broadcast 3411 from newAPIHadoopFile at SamSource.java:108
19:00:24.598 INFO  FileInputFormat - Total input files to process : 1
19:00:24.602 INFO  SparkContext - Starting job: count at CollectMultipleMetricsSparkIntegrationTest.java:130
19:00:24.602 INFO  DAGScheduler - Got job 892 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) with 1 output partitions
19:00:24.602 INFO  DAGScheduler - Final stage: ResultStage 2485 (count at CollectMultipleMetricsSparkIntegrationTest.java:130)
19:00:24.602 INFO  DAGScheduler - Parents of final stage: List()
19:00:24.602 INFO  DAGScheduler - Missing parents: List()
19:00:24.602 INFO  DAGScheduler - Submitting ResultStage 2485 (MapPartitionsRDD[10243] at filter at CollectMultipleMetricsSpark.java:193), which has no missing parents
19:00:24.602 INFO  MemoryStore - Block broadcast_3412 stored as values in memory (estimated size 34.8 KiB, free 1905.4 MiB)
19:00:24.603 INFO  MemoryStore - Block broadcast_3412_piece0 stored as bytes in memory (estimated size 14.6 KiB, free 1905.4 MiB)
19:00:24.603 INFO  BlockManagerInfo - Added broadcast_3412_piece0 in memory on localhost:40133 (size: 14.6 KiB, free: 1917.4 MiB)
19:00:24.603 INFO  SparkContext - Created broadcast 3412 from broadcast at DAGScheduler.scala:1580
19:00:24.603 INFO  DAGScheduler - Submitting 1 missing tasks from ResultStage 2485 (MapPartitionsRDD[10243] at filter at CollectMultipleMetricsSpark.java:193) (first 15 tasks are for partitions Vector(0))
19:00:24.603 INFO  TaskSchedulerImpl - Adding task set 2485.0 with 1 tasks resource profile 0
19:00:24.603 INFO  TaskSetManager - Starting task 0.0 in stage 2485.0 (TID 1916) (localhost, executor driver, partition 0, PROCESS_LOCAL, 9772 bytes) 
19:00:24.604 INFO  Executor - Running task 0.0 in stage 2485.0 (TID 1916)
19:00:24.605 INFO  NewHadoopRDD - Input split: file:/home/runner/work/gatk/gatk/src/test/resources/org/broadinstitute/hellbender/metrics/analysis/CollectInsertSizeMetrics/insert_size_metrics_test.sam:0+44008
19:00:24.606 INFO  Executor - Finished task 0.0 in stage 2485.0 (TID 1916). 946 bytes result sent to driver
19:00:24.606 INFO  TaskSetManager - Finished task 0.0 in stage 2485.0 (TID 1916) in 3 ms on localhost (executor driver) (1/1)
19:00:24.606 INFO  TaskSchedulerImpl - Removed TaskSet 2485.0, whose tasks have all completed, from pool 
19:00:24.606 INFO  DAGScheduler - ResultStage 2485 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) finished in 0.004 s
19:00:24.606 INFO  DAGScheduler - Job 892 is finished. Cancelling potential speculative or zombie tasks for this job
19:00:24.606 INFO  TaskSchedulerImpl - Killing all running tasks in stage 2485: Stage finished
19:00:24.606 INFO  DAGScheduler - Job 892 finished: count at CollectMultipleMetricsSparkIntegrationTest.java:130, took 0.004542 s
19:00:24.606 INFO  CollectMultipleMetricsSpark - Shutting down engine
[May 19, 2025 at 7:00:24 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1679818752
19:00:24.611 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.611 INFO  CollectMultipleMetricsSpark - org.broadinstitute.hellbender.tools.spark.pipelines.metrics vUnavailable
19:00:24.611 INFO  CollectMultipleMetricsSpark - For support and documentation go to https://software.broadinstitute.org/gatk/
19:00:24.611 INFO  CollectMultipleMetricsSpark - Executing as runner@pkrvmf6wy0o8zjz on Linux v6.11.0-1014-azure amd64
19:00:24.611 INFO  CollectMultipleMetricsSpark - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10
19:00:24.611 INFO  CollectMultipleMetricsSpark - Start Date/Time: May 19, 2025 at 7:00:24 PM UTC
19:00:24.611 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.611 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.611 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.COMPRESSION_LEVEL : 2
19:00:24.611 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
19:00:24.611 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
19:00:24.611 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
19:00:24.611 INFO  CollectMultipleMetricsSpark - Deflater: IntelDeflater
19:00:24.611 INFO  CollectMultipleMetricsSpark - Inflater: IntelInflater
19:00:24.611 INFO  CollectMultipleMetricsSpark - GCS max retries/reopens: 20
19:00:24.611 INFO  CollectMultipleMetricsSpark - Requester pays: disabled
19:00:24.611 WARN  CollectMultipleMetricsSpark - 

?[1m?[31m   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

   Warning: CollectMultipleMetricsSpark is a BETA tool and is not yet ready for use in production

   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!?[0m


19:00:24.611 INFO  CollectMultipleMetricsSpark - Initializing engine
19:00:24.611 INFO  CollectMultipleMetricsSpark - Done initializing engine
19:00:24.611 INFO  CollectMultipleMetricsSpark - Spark verbosity set to INFO (see --spark-verbosity argument)
19:00:24.613 INFO  MemoryStore - Block broadcast_3413 stored as values in memory (estimated size 306.3 KiB, free 1905.1 MiB)
19:00:24.619 INFO  MemoryStore - Block broadcast_3413_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1905.0 MiB)
19:00:24.619 INFO  BlockManagerInfo - Added broadcast_3413_piece0 in memory on localhost:40133 (size: 64.4 KiB, free: 1917.3 MiB)
19:00:24.619 INFO  SparkContext - Created broadcast 3413 from newAPIHadoopFile at PathSplitSource.java:96
19:00:24.639 INFO  MemoryStore - Block broadcast_3414 stored as values in memory (estimated size 306.3 KiB, free 1904.7 MiB)
19:00:24.645 INFO  MemoryStore - Block broadcast_3414_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1904.7 MiB)
19:00:24.645 INFO  BlockManagerInfo - Added broadcast_3414_piece0 in memory on localhost:40133 (size: 64.4 KiB, free: 1917.2 MiB)
19:00:24.645 INFO  SparkContext - Created broadcast 3414 from newAPIHadoopFile at PathSplitSource.java:96
19:00:24.665 INFO  FileInputFormat - Total input files to process : 1
19:00:24.668 INFO  SparkContext - Starting job: count at CollectMultipleMetricsSparkIntegrationTest.java:130
19:00:24.668 INFO  DAGScheduler - Got job 893 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) with 1 output partitions
19:00:24.668 INFO  DAGScheduler - Final stage: ResultStage 2486 (count at CollectMultipleMetricsSparkIntegrationTest.java:130)
19:00:24.668 INFO  DAGScheduler - Parents of final stage: List()
19:00:24.668 INFO  DAGScheduler - Missing parents: List()
19:00:24.668 INFO  DAGScheduler - Submitting ResultStage 2486 (MapPartitionsRDD[10256] at filter at CollectMultipleMetricsSpark.java:193), which has no missing parents
19:00:24.685 INFO  MemoryStore - Block broadcast_3415 stored as values in memory (estimated size 478.0 KiB, free 1904.2 MiB)
19:00:24.687 INFO  MemoryStore - Block broadcast_3415_piece0 stored as bytes in memory (estimated size 208.0 KiB, free 1904.0 MiB)
19:00:24.687 INFO  BlockManagerInfo - Added broadcast_3415_piece0 in memory on localhost:40133 (size: 208.0 KiB, free: 1917.0 MiB)
19:00:24.687 INFO  SparkContext - Created broadcast 3415 from broadcast at DAGScheduler.scala:1580
19:00:24.687 INFO  DAGScheduler - Submitting 1 missing tasks from ResultStage 2486 (MapPartitionsRDD[10256] at filter at CollectMultipleMetricsSpark.java:193) (first 15 tasks are for partitions Vector(0))
19:00:24.687 INFO  TaskSchedulerImpl - Adding task set 2486.0 with 1 tasks resource profile 0
19:00:24.688 INFO  TaskSetManager - Starting task 0.0 in stage 2486.0 (TID 1917) (localhost, executor driver, partition 0, PROCESS_LOCAL, 9772 bytes) 
19:00:24.688 INFO  Executor - Running task 0.0 in stage 2486.0 (TID 1917)
19:00:24.718 INFO  NewHadoopRDD - Input split: file:/home/runner/work/gatk/gatk/src/test/resources/org/broadinstitute/hellbender/metrics/analysis/CollectInsertSizeMetrics/insert_size_metrics_test.bam:0+8071
19:00:24.721 INFO  Executor - Finished task 0.0 in stage 2486.0 (TID 1917). 989 bytes result sent to driver
19:00:24.721 INFO  TaskSetManager - Finished task 0.0 in stage 2486.0 (TID 1917) in 33 ms on localhost (executor driver) (1/1)
19:00:24.722 INFO  TaskSchedulerImpl - Removed TaskSet 2486.0, whose tasks have all completed, from pool 
19:00:24.722 INFO  DAGScheduler - ResultStage 2486 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) finished in 0.054 s
19:00:24.722 INFO  DAGScheduler - Job 893 is finished. Cancelling potential speculative or zombie tasks for this job
19:00:24.722 INFO  TaskSchedulerImpl - Killing all running tasks in stage 2486: Stage finished
19:00:24.722 INFO  DAGScheduler - Job 893 finished: count at CollectMultipleMetricsSparkIntegrationTest.java:130, took 0.053935 s
19:00:24.722 INFO  CollectMultipleMetricsSpark - Shutting down engine
[May 19, 2025 at 7:00:24 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1679818752
19:00:24.726 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.726 INFO  CollectMultipleMetricsSpark - org.broadinstitute.hellbender.tools.spark.pipelines.metrics vUnavailable
19:00:24.726 INFO  CollectMultipleMetricsSpark - For support and documentation go to https://software.broadinstitute.org/gatk/
19:00:24.726 INFO  CollectMultipleMetricsSpark - Executing as runner@pkrvmf6wy0o8zjz on Linux v6.11.0-1014-azure amd64
19:00:24.726 INFO  CollectMultipleMetricsSpark - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10
19:00:24.726 INFO  CollectMultipleMetricsSpark - Start Date/Time: May 19, 2025 at 7:00:24 PM UTC
19:00:24.726 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.726 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
19:00:24.726 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.COMPRESSION_LEVEL : 2
19:00:24.726 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
19:00:24.726 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
19:00:24.726 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
19:00:24.726 INFO  CollectMultipleMetricsSpark - Deflater: IntelDeflater
19:00:24.726 INFO  CollectMultipleMetricsSpark - Inflater: IntelInflater
19:00:24.726 INFO  CollectMultipleMetricsSpark - GCS max retries/reopens: 20
19:00:24.726 INFO  CollectMultipleMetricsSpark - Requester pays: disabled
19:00:24.726 WARN  CollectMultipleMetricsSpark - 

?[1m?[31m   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

   Warning: CollectMultipleMetricsSpark is a BETA tool and is not yet ready for use in production

   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!?[0m


19:00:24.726 INFO  CollectMultipleMetricsSpark - Initializing engine
19:00:24.726 INFO  CollectMultipleMetricsSpark - Done initializing engine
19:00:24.726 INFO  CollectMultipleMetricsSpark - Spark verbosity set to INFO (see --spark-verbosity argument)
19:00:24.728 INFO  MemoryStore - Block broadcast_3416 stored as values in memory (estimated size 600.0 B, free 1904.0 MiB)
19:00:24.729 INFO  MemoryStore - Block broadcast_3416_piece0 stored as bytes in memory (estimated size 211.0 B, free 1904.0 MiB)
19:00:24.729 INFO  BlockManagerInfo - Added broadcast_3416_piece0 in memory on localhost:40133 (size: 211.0 B, free: 1917.0 MiB)
19:00:24.729 INFO  SparkContext - Created broadcast 3416 from broadcast at CramSource.java:114
19:00:24.730 INFO  MemoryStore - Block broadcast_3417 stored as values in memory (estimated size 306.3 KiB, free 1903.7 MiB)
19:00:24.736 INFO  MemoryStore - Block broadcast_3417_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1903.6 MiB)
19:00:24.736 INFO  BlockManagerInfo - Added broadcast_3417_piece0 in memory on localhost:40133 (size: 64.4 KiB, free: 1917.0 MiB)
19:00:24.736 INFO  SparkContext - Created broadcast 3417 from newAPIHadoopFile at PathSplitSource.java:96
19:00:24.750 INFO  MemoryStore - Block broadcast_3418 stored as values in memory (estimated size 600.0 B, free 1903.6 MiB)
19:00:24.751 INFO  MemoryStore - Block broadcast_3418_piece0 stored as bytes in memory (estimated size 211.0 B, free 1903.6 MiB)
19:00:24.751 INFO  BlockManagerInfo - Added broadcast_3418_piece0 in memory on localhost:40133 (size: 211.0 B, free: 1917.0 MiB)
19:00:24.751 INFO  SparkContext - Created broadcast 3418 from broadcast at CramSource.java:114
19:00:24.751 INFO  MemoryStore - Block broadcast_3419 stored as values in memory (estimated size 306.3 KiB, free 1903.3 MiB)
19:00:24.758 INFO  MemoryStore - Block broadcast_3419_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1903.3 MiB)
19:00:24.758 INFO  BlockManagerInfo - Added broadcast_3419_piece0 in memory on localhost:40133 (size: 64.4 KiB, free: 1916.9 MiB)
19:00:24.758 INFO  SparkContext - Created broadcast 3419 from newAPIHadoopFile at PathSplitSource.java:96
19:00:24.772 INFO  FileInputFormat - Total input files to process : 1
19:00:24.775 INFO  SparkContext - Starting job: count at CollectMultipleMetricsSparkIntegrationTest.java:130
19:00:24.775 INFO  DAGScheduler - Got job 894 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) with 1 output partitions
19:00:24.775 INFO  DAGScheduler - Final stage: ResultStage 2487 (count at CollectMultipleMetricsSparkIntegrationTest.java:130)
19:00:24.775 INFO  DAGScheduler - Parents of final stage: List()
19:00:24.775 INFO  DAGScheduler - Missing parents: List()
19:00:24.775 INFO  DAGScheduler - Submitting ResultStage 2487 (MapPartitionsRDD[10267] at filter at CollectMultipleMetricsSpark.java:193), which has no missing parents
19:00:24.786 INFO  MemoryStore - Block broadcast_3420 stored as values in memory (estimated size 330.5 KiB, free 1902.9 MiB)
19:00:24.788 INFO  MemoryStore - Block broadcast_3420_piece0 stored as bytes in memory (estimated size 143.8 KiB, free 1902.8 MiB)
19:00:24.788 INFO  BlockManagerInfo - Added broadcast_3420_piece0 in memory on localhost:40133 (size: 143.8 KiB, free: 1916.8 MiB)
19:00:24.788 INFO  SparkContext - Created broadcast 3420 from broadcast at DAGScheduler.scala:1580
19:00:24.788 INFO  DAGScheduler - Submitting 1 missing tasks from ResultStage 2487 (MapPartitionsRDD[10267] at filter at CollectMultipleMetricsSpark.java:193) (first 15 tasks are for partitions Vector(0))
19:00:24.788 INFO  TaskSchedulerImpl - Adding task set 2487.0 with 1 tasks resource profile 0
19:00:24.789 INFO  TaskSetManager - Starting task 0.0 in stage 2487.0 (TID 1918) (localhost, executor driver, partition 0, PROCESS_LOCAL, 9773 bytes) 
19:00:24.789 INFO  Executor - Running task 0.0 in stage 2487.0 (TID 1918)
19:00:24.811 INFO  NewHadoopRDD - Input split: file:/home/runner/work/gatk/gatk/src/test/resources/org/broadinstitute/hellbender/metrics/analysis/CollectInsertSizeMetrics/insert_size_metrics_test.cram:0+8617
19:00:24.816 INFO  Executor - Finished task 0.0 in stage 2487.0 (TID 1918). 989 bytes result sent to driver
19:00:24.816 INFO  TaskSetManager - Finished task 0.0 in stage 2487.0 (TID 1918) in 27 ms on localhost (executor driver) (1/1)
19:00:24.816 INFO  TaskSchedulerImpl - Removed TaskSet 2487.0, whose tasks have all completed, from pool 
19:00:24.816 INFO  DAGScheduler - ResultStage 2487 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) finished in 0.041 s
19:00:24.816 INFO  DAGScheduler - Job 894 is finished. Cancelling potential speculative or zombie tasks for this job
19:00:24.816 INFO  TaskSchedulerImpl - Killing all running tasks in stage 2487: Stage finished
19:00:24.816 INFO  DAGScheduler - Job 894 finished: count at CollectMultipleMetricsSparkIntegrationTest.java:130, took 0.041253 s
19:00:24.816 INFO  CollectMultipleMetricsSpark - Shutting down engine
[May 19, 2025 at 7:00:24 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1679818752