Class org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSparkIntegrationTest

6

tests

0

failures

0

ignored

0.983s

duration

100%

successful

Tests

Test Duration Result
testBuiltInCollectors[0](insert_size_metrics_test.sam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.145s passed
testBuiltInCollectors[1](insert_size_metrics_test.bam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.326s passed
testBuiltInCollectors[2](insert_size_metrics_test.cram, /home/runner/work/gatk/gatk/src/test/resources/Homo_sapiens_assembly19_chr1_1M.fasta, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.257s passed
testCustomCollectorAPI[0](insert_size_metrics_test.sam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.039s passed
testCustomCollectorAPI[1](insert_size_metrics_test.bam, null, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.117s passed
testCustomCollectorAPI[2](insert_size_metrics_test.cram, /home/runner/work/gatk/gatk/src/test/resources/Homo_sapiens_assembly19_chr1_1M.fasta, expectedInsertSizeMetricsL1.txt, expectedQualityYieldOnInsertSizeMetrics.txt) 0.099s passed

Standard error

[May 27, 2025 at 1:50:41 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1835008000
[May 27, 2025 at 1:50:42 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1835008000
[May 27, 2025 at 1:50:42 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1835008000
13:50:42.319 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.319 INFO  CollectMultipleMetricsSpark - org.broadinstitute.hellbender.tools.spark.pipelines.metrics vUnavailable
13:50:42.319 INFO  CollectMultipleMetricsSpark - For support and documentation go to https://software.broadinstitute.org/gatk/
13:50:42.319 INFO  CollectMultipleMetricsSpark - Executing as runner@pkrvmf6wy0o8zjz on Linux v6.11.0-1014-azure amd64
13:50:42.319 INFO  CollectMultipleMetricsSpark - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10
13:50:42.319 INFO  CollectMultipleMetricsSpark - Start Date/Time: May 27, 2025 at 1:50:42 PM UTC
13:50:42.319 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.319 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.319 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.COMPRESSION_LEVEL : 2
13:50:42.319 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
13:50:42.319 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
13:50:42.319 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
13:50:42.319 INFO  CollectMultipleMetricsSpark - Deflater: IntelDeflater
13:50:42.319 INFO  CollectMultipleMetricsSpark - Inflater: IntelInflater
13:50:42.319 INFO  CollectMultipleMetricsSpark - GCS max retries/reopens: 20
13:50:42.319 INFO  CollectMultipleMetricsSpark - Requester pays: disabled
13:50:42.319 WARN  CollectMultipleMetricsSpark - 

?[1m?[31m   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

   Warning: CollectMultipleMetricsSpark is a BETA tool and is not yet ready for use in production

   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!?[0m


13:50:42.319 INFO  CollectMultipleMetricsSpark - Initializing engine
13:50:42.319 INFO  CollectMultipleMetricsSpark - Done initializing engine
13:50:42.319 INFO  CollectMultipleMetricsSpark - Spark verbosity set to INFO (see --spark-verbosity argument)
WARNING	2025-05-27 13:50:42	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
WARNING	2025-05-27 13:50:42	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
13:50:42.321 INFO  MemoryStore - Block broadcast_3482 stored as values in memory (estimated size 37.8 KiB, free 1905.2 MiB)
13:50:42.321 INFO  MemoryStore - Block broadcast_3482_piece0 stored as bytes in memory (estimated size 8.4 KiB, free 1905.2 MiB)
13:50:42.321 INFO  BlockManagerInfo - Added broadcast_3482_piece0 in memory on localhost:43843 (size: 8.4 KiB, free: 1917.2 MiB)
13:50:42.322 INFO  SparkContext - Created broadcast 3482 from broadcast at SamSource.java:78
13:50:42.322 INFO  MemoryStore - Block broadcast_3483 stored as values in memory (estimated size 306.3 KiB, free 1904.9 MiB)
13:50:42.329 INFO  MemoryStore - Block broadcast_3483_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1904.8 MiB)
13:50:42.329 INFO  BlockManagerInfo - Added broadcast_3483_piece0 in memory on localhost:43843 (size: 64.4 KiB, free: 1917.2 MiB)
13:50:42.329 INFO  SparkContext - Created broadcast 3483 from newAPIHadoopFile at SamSource.java:108
WARNING	2025-05-27 13:50:42	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
WARNING	2025-05-27 13:50:42	SamReaderFactory	Unable to detect file format from input URL or stream, assuming SAM format.
13:50:42.331 INFO  MemoryStore - Block broadcast_3484 stored as values in memory (estimated size 37.8 KiB, free 1904.8 MiB)
13:50:42.332 INFO  MemoryStore - Block broadcast_3484_piece0 stored as bytes in memory (estimated size 8.4 KiB, free 1904.8 MiB)
13:50:42.332 INFO  BlockManagerInfo - Added broadcast_3484_piece0 in memory on localhost:43843 (size: 8.4 KiB, free: 1917.2 MiB)
13:50:42.332 INFO  SparkContext - Created broadcast 3484 from broadcast at SamSource.java:78
13:50:42.333 INFO  MemoryStore - Block broadcast_3485 stored as values in memory (estimated size 306.3 KiB, free 1904.5 MiB)
13:50:42.344 INFO  MemoryStore - Block broadcast_3485_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1904.4 MiB)
13:50:42.344 INFO  BlockManagerInfo - Added broadcast_3485_piece0 in memory on localhost:43843 (size: 64.4 KiB, free: 1917.1 MiB)
13:50:42.344 INFO  SparkContext - Created broadcast 3485 from newAPIHadoopFile at SamSource.java:108
13:50:42.346 INFO  FileInputFormat - Total input files to process : 1
13:50:42.350 INFO  SparkContext - Starting job: count at CollectMultipleMetricsSparkIntegrationTest.java:130
13:50:42.350 INFO  DAGScheduler - Got job 912 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) with 1 output partitions
13:50:42.350 INFO  DAGScheduler - Final stage: ResultStage 2505 (count at CollectMultipleMetricsSparkIntegrationTest.java:130)
13:50:42.350 INFO  DAGScheduler - Parents of final stage: List()
13:50:42.350 INFO  DAGScheduler - Missing parents: List()
13:50:42.350 INFO  DAGScheduler - Submitting ResultStage 2505 (MapPartitionsRDD[10461] at filter at CollectMultipleMetricsSpark.java:193), which has no missing parents
13:50:42.350 INFO  MemoryStore - Block broadcast_3486 stored as values in memory (estimated size 34.8 KiB, free 1904.4 MiB)
13:50:42.351 INFO  MemoryStore - Block broadcast_3486_piece0 stored as bytes in memory (estimated size 14.6 KiB, free 1904.3 MiB)
13:50:42.351 INFO  BlockManagerInfo - Added broadcast_3486_piece0 in memory on localhost:43843 (size: 14.6 KiB, free: 1917.1 MiB)
13:50:42.351 INFO  SparkContext - Created broadcast 3486 from broadcast at DAGScheduler.scala:1580
13:50:42.351 INFO  DAGScheduler - Submitting 1 missing tasks from ResultStage 2505 (MapPartitionsRDD[10461] at filter at CollectMultipleMetricsSpark.java:193) (first 15 tasks are for partitions Vector(0))
13:50:42.351 INFO  TaskSchedulerImpl - Adding task set 2505.0 with 1 tasks resource profile 0
13:50:42.351 INFO  TaskSetManager - Starting task 0.0 in stage 2505.0 (TID 1936) (localhost, executor driver, partition 0, PROCESS_LOCAL, 9772 bytes) 
13:50:42.352 INFO  Executor - Running task 0.0 in stage 2505.0 (TID 1936)
13:50:42.353 INFO  NewHadoopRDD - Input split: file:/home/runner/work/gatk/gatk/src/test/resources/org/broadinstitute/hellbender/metrics/analysis/CollectInsertSizeMetrics/insert_size_metrics_test.sam:0+44008
13:50:42.354 INFO  Executor - Finished task 0.0 in stage 2505.0 (TID 1936). 946 bytes result sent to driver
13:50:42.354 INFO  TaskSetManager - Finished task 0.0 in stage 2505.0 (TID 1936) in 3 ms on localhost (executor driver) (1/1)
13:50:42.354 INFO  TaskSchedulerImpl - Removed TaskSet 2505.0, whose tasks have all completed, from pool 
13:50:42.354 INFO  DAGScheduler - ResultStage 2505 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) finished in 0.004 s
13:50:42.354 INFO  DAGScheduler - Job 912 is finished. Cancelling potential speculative or zombie tasks for this job
13:50:42.354 INFO  TaskSchedulerImpl - Killing all running tasks in stage 2505: Stage finished
13:50:42.354 INFO  DAGScheduler - Job 912 finished: count at CollectMultipleMetricsSparkIntegrationTest.java:130, took 0.004648 s
13:50:42.354 INFO  CollectMultipleMetricsSpark - Shutting down engine
[May 27, 2025 at 1:50:42 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1835008000
13:50:42.359 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.359 INFO  CollectMultipleMetricsSpark - org.broadinstitute.hellbender.tools.spark.pipelines.metrics vUnavailable
13:50:42.359 INFO  CollectMultipleMetricsSpark - For support and documentation go to https://software.broadinstitute.org/gatk/
13:50:42.359 INFO  CollectMultipleMetricsSpark - Executing as runner@pkrvmf6wy0o8zjz on Linux v6.11.0-1014-azure amd64
13:50:42.359 INFO  CollectMultipleMetricsSpark - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10
13:50:42.359 INFO  CollectMultipleMetricsSpark - Start Date/Time: May 27, 2025 at 1:50:42 PM UTC
13:50:42.359 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.359 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.359 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.COMPRESSION_LEVEL : 2
13:50:42.359 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
13:50:42.359 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
13:50:42.359 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
13:50:42.359 INFO  CollectMultipleMetricsSpark - Deflater: IntelDeflater
13:50:42.359 INFO  CollectMultipleMetricsSpark - Inflater: IntelInflater
13:50:42.359 INFO  CollectMultipleMetricsSpark - GCS max retries/reopens: 20
13:50:42.359 INFO  CollectMultipleMetricsSpark - Requester pays: disabled
13:50:42.359 WARN  CollectMultipleMetricsSpark - 

?[1m?[31m   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

   Warning: CollectMultipleMetricsSpark is a BETA tool and is not yet ready for use in production

   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!?[0m


13:50:42.359 INFO  CollectMultipleMetricsSpark - Initializing engine
13:50:42.359 INFO  CollectMultipleMetricsSpark - Done initializing engine
13:50:42.359 INFO  CollectMultipleMetricsSpark - Spark verbosity set to INFO (see --spark-verbosity argument)
13:50:42.361 INFO  MemoryStore - Block broadcast_3487 stored as values in memory (estimated size 306.3 KiB, free 1904.0 MiB)
13:50:42.367 INFO  MemoryStore - Block broadcast_3487_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1904.0 MiB)
13:50:42.367 INFO  BlockManagerInfo - Added broadcast_3487_piece0 in memory on localhost:43843 (size: 64.4 KiB, free: 1917.0 MiB)
13:50:42.367 INFO  SparkContext - Created broadcast 3487 from newAPIHadoopFile at PathSplitSource.java:96
13:50:42.387 INFO  MemoryStore - Block broadcast_3488 stored as values in memory (estimated size 306.3 KiB, free 1903.7 MiB)
13:50:42.393 INFO  MemoryStore - Block broadcast_3488_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1903.6 MiB)
13:50:42.393 INFO  BlockManagerInfo - Added broadcast_3488_piece0 in memory on localhost:43843 (size: 64.4 KiB, free: 1917.0 MiB)
13:50:42.393 INFO  SparkContext - Created broadcast 3488 from newAPIHadoopFile at PathSplitSource.java:96
13:50:42.414 INFO  FileInputFormat - Total input files to process : 1
13:50:42.417 INFO  SparkContext - Starting job: count at CollectMultipleMetricsSparkIntegrationTest.java:130
13:50:42.417 INFO  DAGScheduler - Got job 913 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) with 1 output partitions
13:50:42.417 INFO  DAGScheduler - Final stage: ResultStage 2506 (count at CollectMultipleMetricsSparkIntegrationTest.java:130)
13:50:42.417 INFO  DAGScheduler - Parents of final stage: List()
13:50:42.417 INFO  DAGScheduler - Missing parents: List()
13:50:42.417 INFO  DAGScheduler - Submitting ResultStage 2506 (MapPartitionsRDD[10474] at filter at CollectMultipleMetricsSpark.java:193), which has no missing parents
13:50:42.434 INFO  MemoryStore - Block broadcast_3489 stored as values in memory (estimated size 478.0 KiB, free 1903.2 MiB)
13:50:42.437 INFO  MemoryStore - Block broadcast_3489_piece0 stored as bytes in memory (estimated size 208.0 KiB, free 1903.0 MiB)
13:50:42.437 INFO  BlockManagerInfo - Added broadcast_3489_piece0 in memory on localhost:43843 (size: 208.0 KiB, free: 1916.8 MiB)
13:50:42.437 INFO  SparkContext - Created broadcast 3489 from broadcast at DAGScheduler.scala:1580
13:50:42.437 INFO  DAGScheduler - Submitting 1 missing tasks from ResultStage 2506 (MapPartitionsRDD[10474] at filter at CollectMultipleMetricsSpark.java:193) (first 15 tasks are for partitions Vector(0))
13:50:42.437 INFO  TaskSchedulerImpl - Adding task set 2506.0 with 1 tasks resource profile 0
13:50:42.437 INFO  TaskSetManager - Starting task 0.0 in stage 2506.0 (TID 1937) (localhost, executor driver, partition 0, PROCESS_LOCAL, 9772 bytes) 
13:50:42.437 INFO  Executor - Running task 0.0 in stage 2506.0 (TID 1937)
13:50:42.468 INFO  NewHadoopRDD - Input split: file:/home/runner/work/gatk/gatk/src/test/resources/org/broadinstitute/hellbender/metrics/analysis/CollectInsertSizeMetrics/insert_size_metrics_test.bam:0+8071
13:50:42.471 INFO  Executor - Finished task 0.0 in stage 2506.0 (TID 1937). 989 bytes result sent to driver
13:50:42.471 INFO  TaskSetManager - Finished task 0.0 in stage 2506.0 (TID 1937) in 34 ms on localhost (executor driver) (1/1)
13:50:42.471 INFO  TaskSchedulerImpl - Removed TaskSet 2506.0, whose tasks have all completed, from pool 
13:50:42.471 INFO  DAGScheduler - ResultStage 2506 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) finished in 0.054 s
13:50:42.471 INFO  DAGScheduler - Job 913 is finished. Cancelling potential speculative or zombie tasks for this job
13:50:42.471 INFO  TaskSchedulerImpl - Killing all running tasks in stage 2506: Stage finished
13:50:42.471 INFO  DAGScheduler - Job 913 finished: count at CollectMultipleMetricsSparkIntegrationTest.java:130, took 0.054570 s
13:50:42.472 INFO  CollectMultipleMetricsSpark - Shutting down engine
[May 27, 2025 at 1:50:42 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1835008000
13:50:42.476 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.476 INFO  CollectMultipleMetricsSpark - org.broadinstitute.hellbender.tools.spark.pipelines.metrics vUnavailable
13:50:42.476 INFO  CollectMultipleMetricsSpark - For support and documentation go to https://software.broadinstitute.org/gatk/
13:50:42.476 INFO  CollectMultipleMetricsSpark - Executing as runner@pkrvmf6wy0o8zjz on Linux v6.11.0-1014-azure amd64
13:50:42.476 INFO  CollectMultipleMetricsSpark - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10
13:50:42.476 INFO  CollectMultipleMetricsSpark - Start Date/Time: May 27, 2025 at 1:50:42 PM UTC
13:50:42.476 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.476 INFO  CollectMultipleMetricsSpark - ------------------------------------------------------------
13:50:42.476 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.COMPRESSION_LEVEL : 2
13:50:42.476 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
13:50:42.476 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
13:50:42.476 INFO  CollectMultipleMetricsSpark - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
13:50:42.476 INFO  CollectMultipleMetricsSpark - Deflater: IntelDeflater
13:50:42.476 INFO  CollectMultipleMetricsSpark - Inflater: IntelInflater
13:50:42.476 INFO  CollectMultipleMetricsSpark - GCS max retries/reopens: 20
13:50:42.476 INFO  CollectMultipleMetricsSpark - Requester pays: disabled
13:50:42.476 WARN  CollectMultipleMetricsSpark - 

?[1m?[31m   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

   Warning: CollectMultipleMetricsSpark is a BETA tool and is not yet ready for use in production

   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!?[0m


13:50:42.476 INFO  CollectMultipleMetricsSpark - Initializing engine
13:50:42.476 INFO  CollectMultipleMetricsSpark - Done initializing engine
13:50:42.476 INFO  CollectMultipleMetricsSpark - Spark verbosity set to INFO (see --spark-verbosity argument)
13:50:42.478 INFO  MemoryStore - Block broadcast_3490 stored as values in memory (estimated size 600.0 B, free 1903.0 MiB)
13:50:42.479 INFO  MemoryStore - Block broadcast_3490_piece0 stored as bytes in memory (estimated size 211.0 B, free 1903.0 MiB)
13:50:42.479 INFO  BlockManagerInfo - Added broadcast_3490_piece0 in memory on localhost:43843 (size: 211.0 B, free: 1916.8 MiB)
13:50:42.479 INFO  SparkContext - Created broadcast 3490 from broadcast at CramSource.java:114
13:50:42.480 INFO  MemoryStore - Block broadcast_3491 stored as values in memory (estimated size 306.3 KiB, free 1902.7 MiB)
13:50:42.486 INFO  MemoryStore - Block broadcast_3491_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1902.6 MiB)
13:50:42.486 INFO  BlockManagerInfo - Added broadcast_3491_piece0 in memory on localhost:43843 (size: 64.4 KiB, free: 1916.7 MiB)
13:50:42.486 INFO  SparkContext - Created broadcast 3491 from newAPIHadoopFile at PathSplitSource.java:96
13:50:42.500 INFO  MemoryStore - Block broadcast_3492 stored as values in memory (estimated size 600.0 B, free 1902.6 MiB)
13:50:42.500 INFO  MemoryStore - Block broadcast_3492_piece0 stored as bytes in memory (estimated size 211.0 B, free 1902.6 MiB)
13:50:42.501 INFO  BlockManagerInfo - Added broadcast_3492_piece0 in memory on localhost:43843 (size: 211.0 B, free: 1916.7 MiB)
13:50:42.501 INFO  SparkContext - Created broadcast 3492 from broadcast at CramSource.java:114
13:50:42.501 INFO  MemoryStore - Block broadcast_3493 stored as values in memory (estimated size 306.3 KiB, free 1902.3 MiB)
13:50:42.508 INFO  MemoryStore - Block broadcast_3493_piece0 stored as bytes in memory (estimated size 64.4 KiB, free 1902.2 MiB)
13:50:42.508 INFO  BlockManagerInfo - Added broadcast_3493_piece0 in memory on localhost:43843 (size: 64.4 KiB, free: 1916.6 MiB)
13:50:42.508 INFO  SparkContext - Created broadcast 3493 from newAPIHadoopFile at PathSplitSource.java:96
13:50:42.521 INFO  FileInputFormat - Total input files to process : 1
13:50:42.524 INFO  SparkContext - Starting job: count at CollectMultipleMetricsSparkIntegrationTest.java:130
13:50:42.525 INFO  DAGScheduler - Got job 914 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) with 1 output partitions
13:50:42.525 INFO  DAGScheduler - Final stage: ResultStage 2507 (count at CollectMultipleMetricsSparkIntegrationTest.java:130)
13:50:42.525 INFO  DAGScheduler - Parents of final stage: List()
13:50:42.525 INFO  DAGScheduler - Missing parents: List()
13:50:42.525 INFO  DAGScheduler - Submitting ResultStage 2507 (MapPartitionsRDD[10485] at filter at CollectMultipleMetricsSpark.java:193), which has no missing parents
13:50:42.542 INFO  MemoryStore - Block broadcast_3494 stored as values in memory (estimated size 330.5 KiB, free 1901.9 MiB)
13:50:42.544 INFO  MemoryStore - Block broadcast_3494_piece0 stored as bytes in memory (estimated size 143.8 KiB, free 1901.8 MiB)
13:50:42.544 INFO  BlockManagerInfo - Added broadcast_3494_piece0 in memory on localhost:43843 (size: 143.8 KiB, free: 1916.5 MiB)
13:50:42.544 INFO  SparkContext - Created broadcast 3494 from broadcast at DAGScheduler.scala:1580
13:50:42.544 INFO  DAGScheduler - Submitting 1 missing tasks from ResultStage 2507 (MapPartitionsRDD[10485] at filter at CollectMultipleMetricsSpark.java:193) (first 15 tasks are for partitions Vector(0))
13:50:42.544 INFO  TaskSchedulerImpl - Adding task set 2507.0 with 1 tasks resource profile 0
13:50:42.545 INFO  TaskSetManager - Starting task 0.0 in stage 2507.0 (TID 1938) (localhost, executor driver, partition 0, PROCESS_LOCAL, 9773 bytes) 
13:50:42.545 INFO  Executor - Running task 0.0 in stage 2507.0 (TID 1938)
13:50:42.567 INFO  NewHadoopRDD - Input split: file:/home/runner/work/gatk/gatk/src/test/resources/org/broadinstitute/hellbender/metrics/analysis/CollectInsertSizeMetrics/insert_size_metrics_test.cram:0+8617
13:50:42.571 INFO  Executor - Finished task 0.0 in stage 2507.0 (TID 1938). 989 bytes result sent to driver
13:50:42.571 INFO  TaskSetManager - Finished task 0.0 in stage 2507.0 (TID 1938) in 26 ms on localhost (executor driver) (1/1)
13:50:42.571 INFO  TaskSchedulerImpl - Removed TaskSet 2507.0, whose tasks have all completed, from pool 
13:50:42.571 INFO  DAGScheduler - ResultStage 2507 (count at CollectMultipleMetricsSparkIntegrationTest.java:130) finished in 0.046 s
13:50:42.571 INFO  DAGScheduler - Job 914 is finished. Cancelling potential speculative or zombie tasks for this job
13:50:42.571 INFO  TaskSchedulerImpl - Killing all running tasks in stage 2507: Stage finished
13:50:42.571 INFO  DAGScheduler - Job 914 finished: count at CollectMultipleMetricsSparkIntegrationTest.java:130, took 0.046691 s
13:50:42.571 INFO  CollectMultipleMetricsSpark - Shutting down engine
[May 27, 2025 at 1:50:42 PM UTC] org.broadinstitute.hellbender.tools.spark.pipelines.metrics.CollectMultipleMetricsSpark done. Elapsed time: 0.00 minutes.
Runtime.totalMemory()=1835008000