---
# System prepended metadata

title: '[log] germline: WGS + AWS: g4dn.2xlarge (T4 + 8vCPU + 32GB)'
tags: [Clara, Parabricks-v3.8, 基因體, 二級分析, NVIDIA, Parabricks]

---

[log] germline: WGS + AWS: g4dn.2xlarge (T4 + 8vCPU + 32GB)
===
###### tags: `Parabricks-v3.8`
###### tags: `基因體`, `NVIDIA`, `Clara`, `Parabricks`, `二級分析`

<br>

[TOC]

<br>

## 硬體資源：EC2 / g4dn.2xlarge
> 查閱方式：[[HackMD] AWS / 容器執行個體(EC2) / EC2 / g4dn.4xlarge](https://hackmd.io/QavypnMBRoW8P9aH4gw8FA#EC2--g4dnxlarge)

[![](https://i.imgur.com/MKx9iRZ.png)](https://i.imgur.com/MKx9iRZ.png)

### GPU
- GPU 0: Tesla T4 (15360MiB)

### CPU
- Intel® Xeon® Platinum 8259CL CPU @ 2.50GHz
- 1(插槽) x 4(核/插槽) x 2(超執行緒/核) = 8條執行緒 (16vCPU)
- cpu MHz: 3100
- BogoMIPS: 5000
- :::spoiler `$ lscpu`
    ```
    $ lscpu
    Architecture:        x86_64
    CPU op-mode(s):      32-bit, 64-bit
    Byte Order:          Little Endian
    CPU(s):              8
    On-line CPU(s) list: 0-7
    Thread(s) per core:  2
    Core(s) per socket:  4
    Socket(s):           1
    NUMA node(s):        1
    Vendor ID:           GenuineIntel
    CPU family:          6
    Model:               85
    Model name:          Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
    Stepping:            7
    CPU MHz:             3100.003
    BogoMIPS:            5000.00
    Hypervisor vendor:   KVM
    Virtualization type: full
    L1d cache:           32K
    L1i cache:           32K
    L2 cache:            1024K
    L3 cache:            36608K
    NUMA node0 CPU(s):   0-7
    Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves ida arat pku ospke avx512_vnni
    ```
    :::
### RAM
- 16GB

### Storage


- **規格**：`General Purpose SSD (gp3)`, `14600IOPS`, `571MiB`
- **儲存容量**
    - `/`: 50GB
    - `/workspace`: 500GB
- **實際效能測試**
    |   | 速度 | IOPS |
    |---|-----|------|
    | Read | 43.1 MiB/s | 11k |
    | Write | 14.4 MiB/s |3680 |
    ```bash=
    $ apt-get install -y fio

    $ fio \
      --randrepeat=1 \
      --ioengine=libaio \
      --direct=1 \
      --gtod_reduce=1 \
      --name=fiotest \
      --filename=testfio \
      --bs=4k \
      --iodepth=64 \
      --size=8G \
      --readwrite=randrw \
      --rwmixread=75
    ```
    :::spoiler 點此查看 **執行結果**
    ```
    fiotest: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
    fio-3.1
    Starting 1 process
    Jobs: 1 (f=1): [m(1)][100.0%][r=42.5MiB/s,w=14.5MiB/s][r=10.9k,w=3718 IOPS][eta 00m:00s]
    fiotest: (groupid=0, jobs=1): err= 0: pid=24746: Mon Mar 21 09:55:20 2022
       read: IOPS=11.0k, BW=43.1MiB/s (45.1MB/s)(6141MiB/142634msec)
       bw (  KiB/s): min=42832, max=119600, per=99.99%, avg=44083.46, stdev=4551.88, samples=285
       iops        : min=10708, max=29900, avg=11020.86, stdev=1137.97, samples=285
      write: IOPS=3680, BW=14.4MiB/s (15.1MB/s)(2051MiB/142634msec)
       bw (  KiB/s): min=13600, max=39784, per=99.99%, avg=14721.11, stdev=1537.27, samples=285
       iops        : min= 3400, max= 9946, avg=3680.25, stdev=384.32, samples=285
      cpu          : usr=2.24%, sys=6.38%, ctx=641532, majf=0, minf=8
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued rwt: total=1572145,525007,0, short=0,0,0, dropped=0,0,0
         latency   : target=0, window=0, percentile=100.00%, depth=64

    Run status group 0 (all jobs):
       READ: bw=43.1MiB/s (45.1MB/s), 43.1MiB/s-43.1MiB/s (45.1MB/s-45.1MB/s), io=6141MiB (6440MB), run=142634-142634msec
      WRITE: bw=14.4MiB/s (15.1MB/s), 14.4MiB/s-14.4MiB/s (15.1MB/s-15.1MB/s), io=2051MiB (2150MB), run=142634-142634msec

    Disk stats (read/write):
      nvme2n1: ios=1569518/524146, merge=0/4, ticks=3147945/1116778, in_queue=6120, util=99.97%
    ```
    :::
<br>

<hr>

<br>

## script 
```bash=
# cmd: sh germline.sh 2>&1 | tee germline.sh.log &

date && start_time=`date +%s` && echo "start_time:" $start_time

pbrun germline \
  --ref parabricks_sample/Ref/Homo_sapiens_assembly38.fasta \
  --in-fq \
    datasets/WGS-LIS-AI018A_R1.fastq.gz \
    datasets/WGS-LIS-AI018A_R2.fastq.gz \
  --knownSites parabricks_sample/Ref/Homo_sapiens_assembly38.known_indels.vcf.gz \
  --out-bam        output/output.bam \
  --out-variants   output/output.vcf \
  --out-recal-file output/report.txt \
  ; \
  echo "exit code:" $!; \
  echo "Done!"

date && end_time=`date +%s` && echo "end_time:" $end_time

total=$((end_time - start_time))
time_h=$((total/3600))
time_m=$(( (total - time_h*3600) / 60 ))
time_s=$(( total - time_h*3600 - time_m*60 ))
echo "Total time: ${time_h}h ${time_m}m ${time_s}s"
```

<br>

<hr>

<br>

## 執行狀況評估
> **g4dn.2xlarge (T4 + 8vCPU + 16GB)**

:::warning
:warning: `--memory-limit`
30, 28, 26, 20(P3: 90.4%) 皆被 **killed**，跑不起來
:::

| # | ml | nct | Total | P1 | P2 | P3 | P4 |
|---|----|-----|-----:|---:|---:|---:|---:|
| 1 | -  | -   | **7h 58m 13s** | 5h 28m 34s | 6m 50s | 52m 41s | 1h 30m 00s |
| 1 | 16 | -   | **8h 01m 50s** | 5h 34m 11s | 6m 41s | 52m 02s | 1h 28m 51s |
| 1 | 20 | 2   | **7h 57m 51s** | 5h 28m 48s | 6m 41s | 52m 01s | 1h 30m 30s |
| 1 | 26 | 1   | **** |  |  |  |  |

- params
    - **ng**: `--num-gpus`
    - **ml**: `--memory-limit`
    - **nct**: `--num-cpu-threads`
- P: Program
    - **P1**: GPU-BWA mem, Sorting Phase-I
    - **P2**: Sorting Phase-II
    - **P3**: Marking Dmuplicates, BQSR	
    - **P4**: GPU-GATK4 HaplotypeCaller	

<br>

<hr>

<br>

## Log
```=
$ sh germline.sh 2>&1 | tee germline.sh.log &
[1] 27305
Mon Mar 21 01:39:17 UTC 2022
start_time: 1647826757
Please visit https://docs.nvidia.com/clara/#parabricks for detailed documentation


[Parabricks Options Mesg]: Automatically generating ID prefix
[Parabricks Options Mesg]: Read group created for /workspace/datasets/WGS-LIS-AI018A_R1.fastq.gz and
/workspace/datasets/WGS-LIS-AI018A_R2.fastq.gz
[Parabricks Options Mesg]: @RG\tID:H3WFJDSXX.1\tLB:lib1\tPL:bar\tSM:sample\tPU:H3WFJDSXX.1

[Parabricks Options Mesg]: Checking argument compatibility
[Parabricks Options Mesg]: Read group created for /workspace/datasets/WGS-LIS-AI018A_R1.fastq.gz and
/workspace/datasets/WGS-LIS-AI018A_R2.fastq.gz
[Parabricks Options Mesg]: @RG\tID:H3WFJDSXX.1\tLB:lib1\tPL:bar\tSM:sample\tPU:H3WFJDSXX.1
[PB Info 2022-Mar-21 01:39:18] Logger not initialized! 
[PB Info 2022-Mar-21 01:39:18] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 01:39:18] ||                 Parabricks accelerated Genomics Pipeline                 ||
[PB Info 2022-Mar-21 01:39:18] ||                              Version 3.7.0-1                             ||
[PB Info 2022-Mar-21 01:39:18] ||                       GPU-BWA mem, Sorting Phase-I                       ||
[PB Info 2022-Mar-21 01:39:18] ||                  Contact: Parabricks-Support@nvidia.com                  ||
[PB Info 2022-Mar-21 01:39:18] ------------------------------------------------------------------------------
gpg: keyblock resource '/home/ubuntu/.gnupg/pubring.kbx': Permission denied
[PB Info 2022-Mar-21 01:39:19] Logger already initialized, continuing with current settings.
[M::bwa_idx_load_from_disk] read 0 ALT contigs
[PB Warning 2022-Mar-21 01:39:36][ParaBricks/src/pbOpts.cu:316] 

WARNING
The system has 30 GB, however recommended RAM with 1 GPU is 64 GB.
The run might not finish or might have less than expected performance.

[PB Warning 2022-Mar-21 01:39:36][ParaBricks/src/pbOpts.cu:325] 

WARNING
The system has 8 threads, however recommended number of threads with 1 GPU is 16.
The run might not finish or might have less than expected performance.

[PB Info 2022-Mar-21 01:39:36] GPU-BWA mem
[PB Info 2022-Mar-21 01:39:36] ProgressMeter	Reads		Base Pairs Aligned
[PB Info 2022-Mar-21 01:41:27] 5033176		760000000
[PB Info 2022-Mar-21 01:43:12] 10066352	1520000000
[PB Info 2022-Mar-21 01:44:57] 15099528	2280000000
[PB Info 2022-Mar-21 01:46:46] 20132704	3040000000
[PB Info 2022-Mar-21 01:48:34] 25165880	3800000000
[PB Info 2022-Mar-21 01:50:18] 30199056	4560000000
[PB Info 2022-Mar-21 01:52:04] 35232232	5320000000
[PB Info 2022-Mar-21 01:53:54] 40265408	6080000000
[PB Info 2022-Mar-21 01:55:44] 45298584	6840000000
[PB Info 2022-Mar-21 01:57:31] 50331760	7600000000
[PB Info 2022-Mar-21 01:59:16] 55364936	8360000000
[PB Info 2022-Mar-21 02:01:03] 60398112	9120000000
[PB Info 2022-Mar-21 02:02:49] 65431288	9880000000
[PB Info 2022-Mar-21 02:04:37] 70464464	10640000000
[PB Info 2022-Mar-21 02:06:25] 75497640	11400000000
[PB Info 2022-Mar-21 02:08:10] 80530816	12160000000
[PB Info 2022-Mar-21 02:09:59] 85563992	12920000000
[PB Info 2022-Mar-21 02:11:46] 90597168	13680000000
[PB Info 2022-Mar-21 02:13:32] 95630344	14440000000
[PB Info 2022-Mar-21 02:15:19] 100663520	15200000000
[PB Info 2022-Mar-21 02:17:07] 105696696	15960000000
[PB Info 2022-Mar-21 02:18:56] 110729872	16720000000
[PB Info 2022-Mar-21 02:20:44] 115763048	17480000000
[PB Info 2022-Mar-21 02:22:29] 120796224	18240000000
[PB Info 2022-Mar-21 02:24:13] 125829400	19000000000
[PB Info 2022-Mar-21 02:25:58] 130862576	19760000000
[PB Info 2022-Mar-21 02:27:42] 135895752	20520000000
[PB Info 2022-Mar-21 02:29:29] 140928928	21280000000
[PB Info 2022-Mar-21 02:31:16] 145962104	22040000000
[PB Info 2022-Mar-21 02:33:00] 150995280	22800000000
[PB Info 2022-Mar-21 02:34:45] 156028456	23560000000
[PB Info 2022-Mar-21 02:36:33] 161061632	24320000000
[PB Info 2022-Mar-21 02:38:18] 166094808	25080000000
[PB Info 2022-Mar-21 02:40:04] 171127984	25840000000
[PB Info 2022-Mar-21 02:41:53] 176161160	26600000000
[PB Info 2022-Mar-21 02:43:47] 181194336	27360000000
[PB Info 2022-Mar-21 02:45:38] 186227512	28120000000
[PB Info 2022-Mar-21 02:47:22] 191260688	28880000000
[PB Info 2022-Mar-21 02:49:08] 196293864	29640000000
[PB Info 2022-Mar-21 02:50:57] 201327040	30400000000
[PB Info 2022-Mar-21 02:52:43] 206360216	31160000000
[PB Info 2022-Mar-21 02:54:29] 211393392	31920000000
[PB Info 2022-Mar-21 02:56:14] 216426568	32680000000
[PB Info 2022-Mar-21 02:58:01] 221459744	33440000000
[PB Info 2022-Mar-21 02:59:45] 226492920	34200000000
[PB Info 2022-Mar-21 03:01:30] 231526096	34960000000
[PB Info 2022-Mar-21 03:03:16] 236559272	35720000000
[PB Info 2022-Mar-21 03:05:00] 241592448	36480000000
[PB Info 2022-Mar-21 03:06:44] 246625624	37240000000
[PB Info 2022-Mar-21 03:08:29] 251658800	38000000000
[PB Info 2022-Mar-21 03:10:15] 256691976	38760000000
[PB Info 2022-Mar-21 03:12:00] 261725152	39520000000
[PB Info 2022-Mar-21 03:13:43] 266758328	40280000000
[PB Info 2022-Mar-21 03:15:30] 271791504	41040000000
[PB Info 2022-Mar-21 03:17:21] 276824680	41800000000
[PB Info 2022-Mar-21 03:19:10] 281857856	42560000000
[PB Info 2022-Mar-21 03:20:57] 286891032	43320000000
[PB Info 2022-Mar-21 03:22:41] 291924208	44080000000
[PB Info 2022-Mar-21 03:24:26] 296957384	44840000000
[PB Info 2022-Mar-21 03:26:09] 301990560	45600000000
[PB Info 2022-Mar-21 03:27:52] 307023736	46360000000
[PB Info 2022-Mar-21 03:29:37] 312056912	47120000000
[PB Info 2022-Mar-21 03:31:25] 317090088	47880000000
[PB Info 2022-Mar-21 03:33:13] 322123264	48640000000
[PB Info 2022-Mar-21 03:35:00] 327156440	49400000000
[PB Info 2022-Mar-21 03:36:47] 332189616	50160000000
[PB Info 2022-Mar-21 03:38:30] 337222792	50920000000
[PB Info 2022-Mar-21 03:40:15] 342255968	51680000000
[PB Info 2022-Mar-21 03:42:04] 347289144	52440000000
[PB Info 2022-Mar-21 03:43:53] 352322320	53200000000
[PB Info 2022-Mar-21 03:45:41] 357355496	53960000000
[PB Info 2022-Mar-21 03:47:24] 362388672	54720000000
[PB Info 2022-Mar-21 03:49:08] 367421848	55480000000
[PB Info 2022-Mar-21 03:50:55] 372455024	56240000000
[PB Info 2022-Mar-21 03:52:42] 377488200	57000000000
[PB Info 2022-Mar-21 03:54:24] 382521376	57760000000
[PB Info 2022-Mar-21 03:56:11] 387554552	58520000000
[PB Info 2022-Mar-21 03:57:55] 392587728	59280000000
[PB Info 2022-Mar-21 03:59:40] 397620904	60040000000
[PB Info 2022-Mar-21 04:01:27] 402654080	60800000000
[PB Info 2022-Mar-21 04:03:14] 407687256	61560000000
[PB Info 2022-Mar-21 04:04:59] 412720432	62320000000
[PB Info 2022-Mar-21 04:06:44] 417753608	63080000000
[PB Info 2022-Mar-21 04:08:30] 422786784	63840000000
[PB Info 2022-Mar-21 04:10:20] 427819960	64600000000
[PB Info 2022-Mar-21 04:12:05] 432853136	65360000000
[PB Info 2022-Mar-21 04:13:48] 437886312	66120000000
[PB Info 2022-Mar-21 04:15:31] 442919488	66880000000
[PB Info 2022-Mar-21 04:17:20] 447952664	67640000000
[PB Info 2022-Mar-21 04:19:07] 452985840	68400000000
[PB Info 2022-Mar-21 04:20:54] 458019016	69160000000
[PB Info 2022-Mar-21 04:22:36] 463052192	69920000000
[PB Info 2022-Mar-21 04:24:21] 468085368	70680000000
[PB Info 2022-Mar-21 04:26:07] 473118544	71440000000
[PB Info 2022-Mar-21 04:27:56] 478151720	72200000000
[PB Info 2022-Mar-21 04:29:40] 483184896	72960000000
[PB Info 2022-Mar-21 04:31:28] 488218072	73720000000
[PB Info 2022-Mar-21 04:33:12] 493251248	74480000000
[PB Info 2022-Mar-21 04:34:59] 498284424	75240000000
[PB Info 2022-Mar-21 04:36:43] 503317600	76000000000
[PB Info 2022-Mar-21 04:38:29] 508350776	76760000000
[PB Info 2022-Mar-21 04:40:15] 513383952	77520000000
[PB Info 2022-Mar-21 04:42:01] 518417128	78280000000
[PB Info 2022-Mar-21 04:43:46] 523450304	79040000000
[PB Info 2022-Mar-21 04:45:33] 528483480	79800000000
[PB Info 2022-Mar-21 04:47:17] 533516656	80560000000
[PB Info 2022-Mar-21 04:49:01] 538549832	81320000000
[PB Info 2022-Mar-21 04:50:44] 543583008	82080000000
[PB Info 2022-Mar-21 04:52:28] 548616184	82840000000
[PB Info 2022-Mar-21 04:54:14] 553649360	83600000000
[PB Info 2022-Mar-21 04:55:59] 558682536	84360000000
[PB Info 2022-Mar-21 04:57:45] 563715712	85120000000
[PB Info 2022-Mar-21 04:59:30] 568748888	85880000000
[PB Info 2022-Mar-21 05:01:17] 573782064	86640000000
[PB Info 2022-Mar-21 05:03:02] 578815240	87400000000
[PB Info 2022-Mar-21 05:04:50] 583848416	88160000000
[PB Info 2022-Mar-21 05:06:35] 588881592	88920000000
[PB Info 2022-Mar-21 05:08:19] 593914768	89680000000
[PB Info 2022-Mar-21 05:10:03] 598947944	90440000000
[PB Info 2022-Mar-21 05:11:49] 603981120	91200000000
[PB Info 2022-Mar-21 05:13:33] 609014296	91960000000
[PB Info 2022-Mar-21 05:15:20] 614047472	92720000000
[PB Info 2022-Mar-21 05:17:03] 619080648	93480000000
[PB Info 2022-Mar-21 05:18:51] 624113824	94240000000
[PB Info 2022-Mar-21 05:20:40] 629147000	95000000000
[PB Info 2022-Mar-21 05:22:23] 634180176	95760000000
[PB Info 2022-Mar-21 05:24:07] 639213352	96520000000
[PB Info 2022-Mar-21 05:25:51] 644246528	97280000000
[PB Info 2022-Mar-21 05:27:35] 649279704	98040000000
[PB Info 2022-Mar-21 05:29:20] 654312880	98800000000
[PB Info 2022-Mar-21 05:31:03] 659346056	99560000000
[PB Info 2022-Mar-21 05:32:48] 664379232	100320000000
[PB Info 2022-Mar-21 05:34:31] 669412408	101080000000
[PB Info 2022-Mar-21 05:36:15] 674445584	101840000000
[PB Info 2022-Mar-21 05:37:58] 679478760	102600000000
[PB Info 2022-Mar-21 05:39:46] 684511936	103360000000
[PB Info 2022-Mar-21 05:41:33] 689545112	104120000000
[PB Info 2022-Mar-21 05:43:19] 694578288	104880000000
[PB Info 2022-Mar-21 05:45:04] 699611464	105640000000
[PB Info 2022-Mar-21 05:46:52] 704644640	106400000000
[PB Info 2022-Mar-21 05:48:39] 709677816	107160000000
[PB Info 2022-Mar-21 05:50:27] 714710992	107920000000
[PB Info 2022-Mar-21 05:52:13] 719744168	108680000000
[PB Info 2022-Mar-21 05:53:57] 724777344	109440000000
[PB Info 2022-Mar-21 05:55:43] 729810520	110200000000
[PB Info 2022-Mar-21 05:57:27] 734843696	110960000000
[PB Info 2022-Mar-21 05:59:12] 739876872	111720000000
[PB Info 2022-Mar-21 06:00:58] 744910048	112480000000
[PB Info 2022-Mar-21 06:02:48] 749943224	113240000000
[PB Info 2022-Mar-21 06:04:36] 754976400	114000000000
[PB Info 2022-Mar-21 06:06:23] 760009576	114760000000
[PB Info 2022-Mar-21 06:08:07] 765042752	115520000000
[PB Info 2022-Mar-21 06:09:51] 770075928	116280000000
[PB Info 2022-Mar-21 06:11:36] 775109104	117040000000
[PB Info 2022-Mar-21 06:13:23] 780142280	117800000000
[PB Info 2022-Mar-21 06:15:09] 785175456	118560000000
[PB Info 2022-Mar-21 06:16:55] 790208632	119320000000
[PB Info 2022-Mar-21 06:18:38] 795241808	120080000000
[PB Info 2022-Mar-21 06:20:26] 800274984	120840000000
[PB Info 2022-Mar-21 06:22:15] 805308160	121600000000
[PB Info 2022-Mar-21 06:24:06] 810341336	122360000000
[PB Info 2022-Mar-21 06:25:53] 815374512	123120000000
[PB Info 2022-Mar-21 06:27:37] 820407688	123880000000
[PB Info 2022-Mar-21 06:29:21] 825440864	124640000000
[PB Info 2022-Mar-21 06:31:06] 830474040	125400000000
[PB Info 2022-Mar-21 06:32:48] 835507216	126160000000
[PB Info 2022-Mar-21 06:34:35] 840540392	126920000000
[PB Info 2022-Mar-21 06:36:19] 845573568	127680000000
[PB Info 2022-Mar-21 06:38:03] 850606744	128440000000
[PB Info 2022-Mar-21 06:39:46] 855639920	129200000000
[PB Info 2022-Mar-21 06:41:29] 860673096	129960000000
[PB Info 2022-Mar-21 06:43:14] 865706272	130720000000
[PB Info 2022-Mar-21 06:44:57] 870739448	131480000000
[PB Info 2022-Mar-21 06:46:41] 875772624	132240000000
[PB Info 2022-Mar-21 06:48:27] 880805800	133000000000
[PB Info 2022-Mar-21 06:50:11] 885838976	133760000000
[PB Info 2022-Mar-21 06:51:56] 890872152	134520000000
[PB Info 2022-Mar-21 06:53:39] 895905328	135280000000
[PB Info 2022-Mar-21 06:55:26] 900938504	136040000000
[PB Info 2022-Mar-21 06:57:17] 905971680	136800000000
[PB Info 2022-Mar-21 06:59:04] 911004856	137560000000
[PB Info 2022-Mar-21 07:00:52] 916038032	138320000000
[PB Info 2022-Mar-21 07:02:43] 921071208	139080000000
[PB Info 2022-Mar-21 07:04:31] 926104384	139840000000
[PB Info 2022-Mar-21 07:06:15] 931137560	140600000000
[PB Info 2022-Mar-21 07:07:52] 
GPU-BWA Mem time: 19696.238419 seconds
[PB Info 2022-Mar-21 07:07:52] GPU-BWA Mem is finished.


[main] CMD: PARABRICKS mem -Z ./pbOpts.txt /workspace/parabricks_sample/Ref/Homo_sapiens_assembly38.fasta /workspace/datasets/WGS-LIS-AI018A_R1.fastq.gz /workspace/datasets/WGS-LIS-AI018A_R2.fastq.gz @RG\tID:H3WFJDSXX.1\tLB:lib1\tPL:bar\tSM:sample\tPU:H3WFJDSXX.1
[main] Real time: 19713.634 sec; CPU: 157421.408 sec
[PB Info 2022-Mar-21 07:07:52] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 07:07:52] ||        Program:                      GPU-BWA mem, Sorting Phase-I        ||
[PB Info 2022-Mar-21 07:07:52] ||        Version:                                           3.7.0-1        ||
[PB Info 2022-Mar-21 07:07:52] ||        Start Time:                       Mon Mar 21 01:39:18 2022        ||
[PB Info 2022-Mar-21 07:07:52] ||        End Time:                         Mon Mar 21 07:07:52 2022        ||
[PB Info 2022-Mar-21 07:07:52] ||        Total Time:                         328 minutes 34 seconds        ||
[PB Info 2022-Mar-21 07:07:52] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 07:07:54] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 07:07:54] ||                 Parabricks accelerated Genomics Pipeline                 ||
[PB Info 2022-Mar-21 07:07:54] ||                              Version 3.7.0-1                             ||
[PB Info 2022-Mar-21 07:07:54] ||                             Sorting Phase-II                             ||
[PB Info 2022-Mar-21 07:07:54] ||                  Contact: Parabricks-Support@nvidia.com                  ||
[PB Info 2022-Mar-21 07:07:54] ------------------------------------------------------------------------------
gpg: keyblock resource '/home/ubuntu/.gnupg/pubring.kbx': Permission denied
[PB Info 2022-Mar-21 07:07:54] progressMeter - Percentage
[PB Info 2022-Mar-21 07:07:54] 0.0	 0.00 GB
[PB Info 2022-Mar-21 07:08:04] 0.0	 3.00 GB
[PB Info 2022-Mar-21 07:08:14] 3.0	 3.00 GB
[PB Info 2022-Mar-21 07:08:24] 5.9	 4.00 GB
[PB Info 2022-Mar-21 07:08:34] 8.5	 3.00 GB
[PB Info 2022-Mar-21 07:08:44] 9.9	 3.00 GB
[PB Info 2022-Mar-21 07:08:54] 11.7	 3.00 GB
[PB Info 2022-Mar-21 07:09:04] 14.7	 3.00 GB
[PB Info 2022-Mar-21 07:09:14] 17.5	 3.00 GB
[PB Info 2022-Mar-21 07:09:24] 19.6	 3.00 GB
[PB Info 2022-Mar-21 07:09:34] 21.2	 3.00 GB
[PB Info 2022-Mar-21 07:09:44] 23.7	 3.00 GB
[PB Info 2022-Mar-21 07:09:54] 26.5	 3.00 GB
[PB Info 2022-Mar-21 07:10:04] 29.1	 3.00 GB
[PB Info 2022-Mar-21 07:10:14] 31.5	 3.00 GB
[PB Info 2022-Mar-21 07:10:24] 33.7	 3.00 GB
[PB Info 2022-Mar-21 07:10:34] 36.0	 3.00 GB
[PB Info 2022-Mar-21 07:10:44] 38.5	 3.00 GB
[PB Info 2022-Mar-21 07:10:54] 41.1	 3.00 GB
[PB Info 2022-Mar-21 07:11:04] 43.5	 3.00 GB
[PB Info 2022-Mar-21 07:11:14] 45.7	 2.00 GB
[PB Info 2022-Mar-21 07:11:24] 48.6	 3.00 GB
[PB Info 2022-Mar-21 07:11:34] 51.2	 3.00 GB
[PB Info 2022-Mar-21 07:11:44] 53.1	 3.00 GB
[PB Info 2022-Mar-21 07:11:54] 55.3	 3.00 GB
[PB Info 2022-Mar-21 07:12:04] 58.1	 3.00 GB
[PB Info 2022-Mar-21 07:12:14] 60.6	 3.00 GB
[PB Info 2022-Mar-21 07:12:24] 63.8	 3.00 GB
[PB Info 2022-Mar-21 07:12:34] 65.7	 2.00 GB
[PB Info 2022-Mar-21 07:12:44] 68.5	 2.00 GB
[PB Info 2022-Mar-21 07:12:54] 70.9	 3.00 GB
[PB Info 2022-Mar-21 07:13:04] 73.8	 3.00 GB
[PB Info 2022-Mar-21 07:13:14] 76.7	 3.00 GB
[PB Info 2022-Mar-21 07:13:24] 78.8	 3.00 GB
[PB Info 2022-Mar-21 07:13:34] 80.8	 3.00 GB
[PB Info 2022-Mar-21 07:13:44] 83.2	 3.00 GB
[PB Info 2022-Mar-21 07:13:54] 86.1	 3.00 GB
[PB Info 2022-Mar-21 07:14:04] 88.8	 3.00 GB
[PB Info 2022-Mar-21 07:14:14] 91.2	 1.00 GB
[PB Info 2022-Mar-21 07:14:24] 99.3	 1.00 GB
[PB Info 2022-Mar-21 07:14:34] 99.9	 0.00 GB
[PB Info 2022-Mar-21 07:14:44] Sorting and Marking: 410.011 seconds
[PB Info 2022-Mar-21 07:14:44] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 07:14:44] ||        Program:                                  Sorting Phase-II        ||
[PB Info 2022-Mar-21 07:14:44] ||        Version:                                           3.7.0-1        ||
[PB Info 2022-Mar-21 07:14:44] ||        Start Time:                       Mon Mar 21 07:07:54 2022        ||
[PB Info 2022-Mar-21 07:14:44] ||        End Time:                         Mon Mar 21 07:14:44 2022        ||
[PB Info 2022-Mar-21 07:14:44] ||        Total Time:                           6 minutes 50 seconds        ||
[PB Info 2022-Mar-21 07:14:44] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 07:14:45] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 07:14:45] ||                 Parabricks accelerated Genomics Pipeline                 ||
[PB Info 2022-Mar-21 07:14:45] ||                              Version 3.7.0-1                             ||
[PB Info 2022-Mar-21 07:14:45] ||                         Marking Duplicates, BQSR                         ||
[PB Info 2022-Mar-21 07:14:45] ||                  Contact: Parabricks-Support@nvidia.com                  ||
[PB Info 2022-Mar-21 07:14:45] ------------------------------------------------------------------------------
gpg: keyblock resource '/home/ubuntu/.gnupg/pubring.kbx': Permission denied
[PB Info 2022-Mar-21 07:14:46] progressMeter -	Percentage
[PB Info 2022-Mar-21 07:14:56] 0.0	 9.71 GB
[PB Info 2022-Mar-21 07:15:06] 0.0	 14.12 GB
[PB Info 2022-Mar-21 07:15:16] 0.0	 14.12 GB
[PB Info 2022-Mar-21 07:15:26] 0.0	 14.12 GB
[PB Info 2022-Mar-21 07:15:36] 0.0	 14.12 GB
[PB Info 2022-Mar-21 07:15:46] 0.0	 14.12 GB
[PB Info 2022-Mar-21 07:15:56] 0.4	 14.84 GB
[PB Info 2022-Mar-21 07:16:06] 1.1	 14.62 GB
[PB Info 2022-Mar-21 07:16:16] 1.9	 15.29 GB
[PB Info 2022-Mar-21 07:16:26] 2.7	 14.53 GB
[PB Info 2022-Mar-21 07:16:36] 3.4	 14.98 GB
[PB Info 2022-Mar-21 07:16:46] 3.7	 14.98 GB
[PB Info 2022-Mar-21 07:16:56] 3.7	 14.98 GB
[PB Info 2022-Mar-21 07:17:06] 4.3	 14.86 GB
[PB Info 2022-Mar-21 07:17:16] 4.6	 14.69 GB
[PB Info 2022-Mar-21 07:17:26] 4.9	 14.70 GB
[PB Info 2022-Mar-21 07:17:36] 5.2	 15.58 GB
[PB Info 2022-Mar-21 07:17:46] 5.5	 14.46 GB
[PB Info 2022-Mar-21 07:17:56] 5.8	 14.86 GB
[PB Info 2022-Mar-21 07:18:06] 6.1	 15.30 GB
[PB Info 2022-Mar-21 07:18:16] 6.4	 14.07 GB
[PB Info 2022-Mar-21 07:18:26] 6.7	 14.07 GB
[PB Info 2022-Mar-21 07:18:36] 7.0	 15.09 GB
[PB Info 2022-Mar-21 07:18:46] 7.2	 14.32 GB
[PB Info 2022-Mar-21 07:18:56] 7.6	 14.03 GB
[PB Info 2022-Mar-21 07:19:06] 7.8	 14.88 GB
[PB Info 2022-Mar-21 07:19:16] 8.1	 14.90 GB
[PB Info 2022-Mar-21 07:19:26] 8.4	 15.29 GB
[PB Info 2022-Mar-21 07:19:36] 8.6	 14.48 GB
[PB Info 2022-Mar-21 07:19:46] 8.7	 14.20 GB
[PB Info 2022-Mar-21 07:19:56] 8.9	 14.26 GB
[PB Info 2022-Mar-21 07:20:06] 9.2	 14.24 GB
[PB Info 2022-Mar-21 07:20:16] 9.5	 15.03 GB
[PB Info 2022-Mar-21 07:20:26] 9.8	 14.61 GB
[PB Info 2022-Mar-21 07:20:36] 10.1	 14.98 GB
[PB Info 2022-Mar-21 07:20:46] 10.4	 15.36 GB
[PB Info 2022-Mar-21 07:20:56] 10.7	 14.23 GB
[PB Info 2022-Mar-21 07:21:06] 11.0	 14.60 GB
[PB Info 2022-Mar-21 07:21:16] 11.3	 14.63 GB
[PB Info 2022-Mar-21 07:21:26] 11.6	 14.65 GB
[PB Info 2022-Mar-21 07:21:36] 11.9	 14.27 GB
[PB Info 2022-Mar-21 07:21:46] 12.2	 14.28 GB
[PB Info 2022-Mar-21 07:21:56] 12.5	 14.68 GB
[PB Info 2022-Mar-21 07:22:06] 12.8	 14.74 GB
[PB Info 2022-Mar-21 07:22:16] 13.1	 14.79 GB
[PB Info 2022-Mar-21 07:22:26] 13.4	 14.76 GB
[PB Info 2022-Mar-21 07:22:36] 13.7	 15.16 GB
[PB Info 2022-Mar-21 07:22:46] 14.0	 14.07 GB
[PB Info 2022-Mar-21 07:22:56] 14.3	 14.44 GB
[PB Info 2022-Mar-21 07:23:06] 14.6	 14.89 GB
[PB Info 2022-Mar-21 07:23:16] 14.8	 14.82 GB
[PB Info 2022-Mar-21 07:23:26] 15.2	 14.38 GB
[PB Info 2022-Mar-21 07:23:36] 15.5	 14.37 GB
[PB Info 2022-Mar-21 07:23:46] 15.8	 14.40 GB
[PB Info 2022-Mar-21 07:23:56] 16.1	 14.78 GB
[PB Info 2022-Mar-21 07:24:06] 16.4	 15.09 GB
[PB Info 2022-Mar-21 07:24:16] 16.6	 14.26 GB
[PB Info 2022-Mar-21 07:24:26] 16.9	 14.21 GB
[PB Info 2022-Mar-21 07:24:36] 17.2	 14.59 GB
[PB Info 2022-Mar-21 07:24:46] 17.5	 14.61 GB
[PB Info 2022-Mar-21 07:24:56] 17.8	 14.70 GB
[PB Info 2022-Mar-21 07:25:06] 18.0	 14.25 GB
[PB Info 2022-Mar-21 07:25:16] 18.3	 14.27 GB
[PB Info 2022-Mar-21 07:25:26] 18.6	 14.27 GB
[PB Info 2022-Mar-21 07:25:36] 18.9	 14.24 GB
[PB Info 2022-Mar-21 07:25:46] 19.2	 15.22 GB
[PB Info 2022-Mar-21 07:25:56] 19.4	 14.42 GB
[PB Info 2022-Mar-21 07:26:06] 19.8	 13.99 GB
[PB Info 2022-Mar-21 07:26:16] 20.1	 14.00 GB
[PB Info 2022-Mar-21 07:26:26] 20.4	 14.03 GB
[PB Info 2022-Mar-21 07:26:36] 20.6	 14.01 GB
[PB Info 2022-Mar-21 07:26:46] 20.9	 14.78 GB
[PB Info 2022-Mar-21 07:26:56] 21.2	 14.69 GB
[PB Info 2022-Mar-21 07:27:06] 21.5	 14.99 GB
[PB Info 2022-Mar-21 07:27:16] 21.8	 14.98 GB
[PB Info 2022-Mar-21 07:27:26] 22.2	 15.00 GB
[PB Info 2022-Mar-21 07:27:36] 22.5	 15.30 GB
[PB Info 2022-Mar-21 07:27:46] 22.6	 14.52 GB
[PB Info 2022-Mar-21 07:27:56] 22.8	 15.12 GB
[PB Info 2022-Mar-21 07:28:06] 23.1	 13.98 GB
[PB Info 2022-Mar-21 07:28:16] 23.5	 14.45 GB
[PB Info 2022-Mar-21 07:28:26] 23.8	 14.52 GB
[PB Info 2022-Mar-21 07:28:36] 24.1	 14.50 GB
[PB Info 2022-Mar-21 07:28:46] 24.4	 14.11 GB
[PB Info 2022-Mar-21 07:28:56] 24.7	 14.79 GB
[PB Info 2022-Mar-21 07:29:06] 25.0	 15.18 GB
[PB Info 2022-Mar-21 07:29:16] 25.3	 14.10 GB
[PB Info 2022-Mar-21 07:29:26] 25.6	 15.50 GB
[PB Info 2022-Mar-21 07:29:36] 25.9	 14.33 GB
[PB Info 2022-Mar-21 07:29:46] 26.2	 14.72 GB
[PB Info 2022-Mar-21 07:29:56] 26.5	 14.72 GB
[PB Info 2022-Mar-21 07:30:06] 26.8	 14.33 GB
[PB Info 2022-Mar-21 07:30:16] 27.0	 14.25 GB
[PB Info 2022-Mar-21 07:30:26] 27.4	 15.05 GB
[PB Info 2022-Mar-21 07:30:36] 27.7	 15.02 GB
[PB Info 2022-Mar-21 07:30:46] 28.0	 15.42 GB
[PB Info 2022-Mar-21 07:30:56] 28.3	 14.33 GB
[PB Info 2022-Mar-21 07:31:06] 28.6	 14.86 GB
[PB Info 2022-Mar-21 07:31:16] 28.9	 14.82 GB
[PB Info 2022-Mar-21 07:31:26] 29.2	 15.09 GB
[PB Info 2022-Mar-21 07:31:36] 29.5	 14.70 GB
[PB Info 2022-Mar-21 07:31:46] 29.9	 14.28 GB
[PB Info 2022-Mar-21 07:31:56] 30.2	 14.74 GB
[PB Info 2022-Mar-21 07:32:06] 30.5	 15.33 GB
[PB Info 2022-Mar-21 07:32:16] 30.8	 14.17 GB
[PB Info 2022-Mar-21 07:32:26] 31.1	 14.10 GB
[PB Info 2022-Mar-21 07:32:36] 31.4	 14.05 GB
[PB Info 2022-Mar-21 07:32:46] 31.7	 14.40 GB
[PB Info 2022-Mar-21 07:32:56] 32.0	 14.00 GB
[PB Info 2022-Mar-21 07:33:06] 32.3	 15.12 GB
[PB Info 2022-Mar-21 07:33:16] 32.5	 15.00 GB
[PB Info 2022-Mar-21 07:33:26] 32.8	 15.29 GB
[PB Info 2022-Mar-21 07:33:36] 33.1	 14.18 GB
[PB Info 2022-Mar-21 07:33:46] 33.5	 14.23 GB
[PB Info 2022-Mar-21 07:33:56] 33.7	 14.64 GB
[PB Info 2022-Mar-21 07:34:06] 34.1	 14.28 GB
[PB Info 2022-Mar-21 07:34:16] 34.4	 14.10 GB
[PB Info 2022-Mar-21 07:34:26] 34.6	 14.92 GB
[PB Info 2022-Mar-21 07:34:36] 35.0	 14.98 GB
[PB Info 2022-Mar-21 07:34:46] 35.3	 14.95 GB
[PB Info 2022-Mar-21 07:34:56] 35.6	 14.66 GB
[PB Info 2022-Mar-21 07:35:06] 35.9	 15.04 GB
[PB Info 2022-Mar-21 07:35:16] 36.2	 15.47 GB
[PB Info 2022-Mar-21 07:35:26] 36.5	 14.34 GB
[PB Info 2022-Mar-21 07:35:36] 36.8	 15.50 GB
[PB Info 2022-Mar-21 07:35:46] 37.1	 14.31 GB
[PB Info 2022-Mar-21 07:35:56] 37.4	 15.13 GB
[PB Info 2022-Mar-21 07:36:06] 37.7	 15.13 GB
[PB Info 2022-Mar-21 07:36:16] 38.0	 15.07 GB
[PB Info 2022-Mar-21 07:36:26] 38.3	 14.65 GB
[PB Info 2022-Mar-21 07:36:36] 38.5	 15.07 GB
[PB Info 2022-Mar-21 07:36:46] 38.8	 14.66 GB
[PB Info 2022-Mar-21 07:36:56] 39.1	 14.91 GB
[PB Info 2022-Mar-21 07:37:06] 39.4	 14.42 GB
[PB Info 2022-Mar-21 07:37:16] 39.6	 15.37 GB
[PB Info 2022-Mar-21 07:37:26] 40.0	 15.23 GB
[PB Info 2022-Mar-21 07:37:36] 40.3	 14.16 GB
[PB Info 2022-Mar-21 07:37:46] 40.6	 14.58 GB
[PB Info 2022-Mar-21 07:37:56] 40.9	 14.50 GB
[PB Info 2022-Mar-21 07:38:06] 41.2	 14.89 GB
[PB Info 2022-Mar-21 07:38:16] 41.5	 14.93 GB
[PB Info 2022-Mar-21 07:38:26] 41.8	 14.92 GB
[PB Info 2022-Mar-21 07:38:36] 42.1	 14.64 GB
[PB Info 2022-Mar-21 07:38:46] 42.4	 14.20 GB
[PB Info 2022-Mar-21 07:38:56] 42.7	 14.68 GB
[PB Info 2022-Mar-21 07:39:06] 43.0	 15.07 GB
[PB Info 2022-Mar-21 07:39:16] 43.3	 15.42 GB
[PB Info 2022-Mar-21 07:39:26] 43.6	 14.32 GB
[PB Info 2022-Mar-21 07:39:36] 43.9	 14.34 GB
[PB Info 2022-Mar-21 07:39:46] 44.1	 14.31 GB
[PB Info 2022-Mar-21 07:39:56] 44.4	 14.31 GB
[PB Info 2022-Mar-21 07:40:06] 44.7	 14.10 GB
[PB Info 2022-Mar-21 07:40:16] 45.0	 14.29 GB
[PB Info 2022-Mar-21 07:40:26] 45.2	 14.19 GB
[PB Info 2022-Mar-21 07:40:36] 45.5	 14.58 GB
[PB Info 2022-Mar-21 07:40:46] 45.8	 14.64 GB
[PB Info 2022-Mar-21 07:40:56] 46.2	 14.27 GB
[PB Info 2022-Mar-21 07:41:06] 46.5	 14.27 GB
[PB Info 2022-Mar-21 07:41:16] 46.8	 14.28 GB
[PB Info 2022-Mar-21 07:41:26] 47.0	 14.75 GB
[PB Info 2022-Mar-21 07:41:36] 47.4	 14.84 GB
[PB Info 2022-Mar-21 07:41:46] 47.7	 14.77 GB
[PB Info 2022-Mar-21 07:41:56] 48.0	 14.79 GB
[PB Info 2022-Mar-21 07:42:06] 48.2	 14.04 GB
[PB Info 2022-Mar-21 07:42:16] 48.9	 14.45 GB
[PB Info 2022-Mar-21 07:42:26] 49.3	 14.88 GB
[PB Info 2022-Mar-21 07:42:36] 49.6	 14.79 GB
[PB Info 2022-Mar-21 07:42:46] 49.9	 14.76 GB
[PB Info 2022-Mar-21 07:42:56] 50.1	 15.16 GB
[PB Info 2022-Mar-21 07:43:06] 50.4	 14.04 GB
[PB Info 2022-Mar-21 07:43:16] 50.6	 14.44 GB
[PB Info 2022-Mar-21 07:43:26] 50.9	 14.41 GB
[PB Info 2022-Mar-21 07:43:36] 51.2	 14.29 GB
[PB Info 2022-Mar-21 07:43:46] 51.4	 15.12 GB
[PB Info 2022-Mar-21 07:43:56] 51.7	 15.63 GB
[PB Info 2022-Mar-21 07:44:06] 52.0	 14.46 GB
[PB Info 2022-Mar-21 07:44:16] 52.3	 14.48 GB
[PB Info 2022-Mar-21 07:44:26] 52.5	 14.57 GB
[PB Info 2022-Mar-21 07:44:36] 52.8	 14.89 GB
[PB Info 2022-Mar-21 07:44:46] 53.1	 15.30 GB
[PB Info 2022-Mar-21 07:44:56] 53.4	 14.11 GB
[PB Info 2022-Mar-21 07:45:06] 53.7	 14.07 GB
[PB Info 2022-Mar-21 07:45:16] 54.1	 15.28 GB
[PB Info 2022-Mar-21 07:45:26] 54.4	 14.15 GB
[PB Info 2022-Mar-21 07:45:36] 54.7	 14.15 GB
[PB Info 2022-Mar-21 07:45:46] 55.0	 14.10 GB
[PB Info 2022-Mar-21 07:45:56] 55.2	 14.05 GB
[PB Info 2022-Mar-21 07:46:06] 55.5	 14.38 GB
[PB Info 2022-Mar-21 07:46:16] 55.8	 14.39 GB
[PB Info 2022-Mar-21 07:46:26] 56.0	 14.03 GB
[PB Info 2022-Mar-21 07:46:36] 56.3	 14.00 GB
[PB Info 2022-Mar-21 07:46:46] 56.6	 14.00 GB
[PB Info 2022-Mar-21 07:46:56] 56.9	 14.76 GB
[PB Info 2022-Mar-21 07:47:06] 57.2	 15.17 GB
[PB Info 2022-Mar-21 07:47:16] 57.5	 14.68 GB
[PB Info 2022-Mar-21 07:47:26] 57.8	 14.66 GB
[PB Info 2022-Mar-21 07:47:36] 58.1	 14.77 GB
[PB Info 2022-Mar-21 07:47:46] 58.4	 14.75 GB
[PB Info 2022-Mar-21 07:47:56] 58.8	 14.35 GB
[PB Info 2022-Mar-21 07:48:06] 59.0	 14.32 GB
[PB Info 2022-Mar-21 07:48:16] 59.4	 15.40 GB
[PB Info 2022-Mar-21 07:48:26] 59.7	 14.28 GB
[PB Info 2022-Mar-21 07:48:36] 60.0	 14.21 GB
[PB Info 2022-Mar-21 07:48:46] 60.3	 15.05 GB
[PB Info 2022-Mar-21 07:48:56] 60.6	 14.65 GB
[PB Info 2022-Mar-21 07:49:06] 60.8	 14.71 GB
[PB Info 2022-Mar-21 07:49:16] 61.1	 14.27 GB
[PB Info 2022-Mar-21 07:49:26] 61.4	 15.31 GB
[PB Info 2022-Mar-21 07:49:36] 61.7	 14.05 GB
[PB Info 2022-Mar-21 07:49:46] 61.8	 14.04 GB
[PB Info 2022-Mar-21 07:49:56] 62.2	 15.09 GB
[PB Info 2022-Mar-21 07:50:06] 62.5	 14.01 GB
[PB Info 2022-Mar-21 07:50:16] 62.8	 14.38 GB
[PB Info 2022-Mar-21 07:50:26] 63.1	 14.01 GB
[PB Info 2022-Mar-21 07:50:36] 63.4	 14.86 GB
[PB Info 2022-Mar-21 07:50:46] 64.0	 14.20 GB
[PB Info 2022-Mar-21 07:50:56] 64.3	 14.66 GB
[PB Info 2022-Mar-21 07:51:06] 64.6	 14.66 GB
[PB Info 2022-Mar-21 07:51:16] 64.9	 14.68 GB
[PB Info 2022-Mar-21 07:51:26] 65.2	 14.69 GB
[PB Info 2022-Mar-21 07:51:36] 65.5	 14.73 GB
[PB Info 2022-Mar-21 07:51:46] 65.8	 15.16 GB
[PB Info 2022-Mar-21 07:51:56] 66.2	 14.10 GB
[PB Info 2022-Mar-21 07:52:06] 66.5	 14.63 GB
[PB Info 2022-Mar-21 07:52:16] 66.8	 14.29 GB
[PB Info 2022-Mar-21 07:52:26] 67.6	 14.41 GB
[PB Info 2022-Mar-21 07:52:36] 67.8	 14.39 GB
[PB Info 2022-Mar-21 07:52:46] 68.1	 14.41 GB
[PB Info 2022-Mar-21 07:52:56] 68.4	 14.48 GB
[PB Info 2022-Mar-21 07:53:06] 68.7	 14.89 GB
[PB Info 2022-Mar-21 07:53:16] 69.0	 14.92 GB
[PB Info 2022-Mar-21 07:53:26] 69.3	 14.57 GB
[PB Info 2022-Mar-21 07:53:36] 69.6	 14.12 GB
[PB Info 2022-Mar-21 07:53:46] 69.9	 14.17 GB
[PB Info 2022-Mar-21 07:53:56] 70.8	 14.76 GB
[PB Info 2022-Mar-21 07:54:06] 71.0	 15.26 GB
[PB Info 2022-Mar-21 07:54:16] 71.4	 13.98 GB
[PB Info 2022-Mar-21 07:54:26] 71.7	 13.99 GB
[PB Info 2022-Mar-21 07:54:36] 72.0	 14.41 GB
[PB Info 2022-Mar-21 07:54:46] 72.3	 14.45 GB
[PB Info 2022-Mar-21 07:54:56] 72.6	 13.99 GB
[PB Info 2022-Mar-21 07:55:06] 72.9	 15.19 GB
[PB Info 2022-Mar-21 07:55:16] 73.2	 14.07 GB
[PB Info 2022-Mar-21 07:55:26] 73.5	 14.08 GB
[PB Info 2022-Mar-21 07:55:36] 73.6	 14.52 GB
[PB Info 2022-Mar-21 07:55:46] 74.0	 14.36 GB
[PB Info 2022-Mar-21 07:55:56] 74.2	 14.74 GB
[PB Info 2022-Mar-21 07:56:06] 74.7	 14.48 GB
[PB Info 2022-Mar-21 07:56:16] 74.9	 14.38 GB
[PB Info 2022-Mar-21 07:56:26] 75.1	 14.41 GB
[PB Info 2022-Mar-21 07:56:36] 75.4	 14.52 GB
[PB Info 2022-Mar-21 07:56:46] 75.8	 14.06 GB
[PB Info 2022-Mar-21 07:56:56] 76.0	 14.38 GB
[PB Info 2022-Mar-21 07:57:06] 76.3	 14.72 GB
[PB Info 2022-Mar-21 07:57:16] 76.6	 15.08 GB
[PB Info 2022-Mar-21 07:57:26] 76.9	 14.66 GB
[PB Info 2022-Mar-21 07:57:36] 77.2	 14.89 GB
[PB Info 2022-Mar-21 07:57:46] 77.6	 14.81 GB
[PB Info 2022-Mar-21 07:57:56] 77.9	 14.77 GB
[PB Info 2022-Mar-21 07:58:06] 78.2	 14.65 GB
[PB Info 2022-Mar-21 07:58:16] 78.5	 14.34 GB
[PB Info 2022-Mar-21 07:58:26] 78.7	 14.90 GB
[PB Info 2022-Mar-21 07:58:36] 79.0	 15.15 GB
[PB Info 2022-Mar-21 07:58:46] 79.3	 14.04 GB
[PB Info 2022-Mar-21 07:58:56] 79.5	 14.08 GB
[PB Info 2022-Mar-21 07:59:06] 79.8	 14.10 GB
[PB Info 2022-Mar-21 07:59:16] 80.2	 14.73 GB
[PB Info 2022-Mar-21 07:59:26] 80.5	 15.40 GB
[PB Info 2022-Mar-21 07:59:36] 80.8	 14.24 GB
[PB Info 2022-Mar-21 07:59:46] 81.1	 14.68 GB
[PB Info 2022-Mar-21 07:59:56] 81.4	 14.04 GB
[PB Info 2022-Mar-21 08:00:06] 81.7	 15.26 GB
[PB Info 2022-Mar-21 08:00:16] 82.0	 14.42 GB
[PB Info 2022-Mar-21 08:00:26] 82.3	 14.30 GB
[PB Info 2022-Mar-21 08:00:36] 82.6	 14.21 GB
[PB Info 2022-Mar-21 08:00:46] 82.9	 14.30 GB
[PB Info 2022-Mar-21 08:00:56] 83.2	 14.51 GB
[PB Info 2022-Mar-21 08:01:06] 83.5	 14.48 GB
[PB Info 2022-Mar-21 08:01:16] 83.8	 14.30 GB
[PB Info 2022-Mar-21 08:01:26] 84.0	 14.49 GB
[PB Info 2022-Mar-21 08:01:36] 84.3	 14.49 GB
[PB Info 2022-Mar-21 08:01:46] 84.6	 14.43 GB
[PB Info 2022-Mar-21 08:01:56] 84.9	 14.71 GB
[PB Info 2022-Mar-21 08:02:06] 85.1	 14.55 GB
[PB Info 2022-Mar-21 08:02:16] 85.3	 14.82 GB
[PB Info 2022-Mar-21 08:02:26] 85.6	 14.88 GB
[PB Info 2022-Mar-21 08:02:36] 85.9	 14.88 GB
[PB Info 2022-Mar-21 08:02:46] 86.2	 14.45 GB
[PB Info 2022-Mar-21 08:02:56] 86.9	 14.21 GB
[PB Info 2022-Mar-21 08:03:06] 87.1	 14.94 GB
[PB Info 2022-Mar-21 08:03:16] 87.4	 14.89 GB
[PB Info 2022-Mar-21 08:03:26] 87.7	 14.82 GB
[PB Info 2022-Mar-21 08:03:36] 88.0	 14.39 GB
[PB Info 2022-Mar-21 08:03:46] 88.3	 14.77 GB
[PB Info 2022-Mar-21 08:03:56] 88.6	 14.77 GB
[PB Info 2022-Mar-21 08:04:06] 88.9	 14.84 GB
[PB Info 2022-Mar-21 08:04:16] 89.3	 14.11 GB
[PB Info 2022-Mar-21 08:04:26] 89.6	 16.99 GB
[PB Info 2022-Mar-21 08:04:36] 89.9	 15.92 GB
[PB Info 2022-Mar-21 08:04:46] 90.2	 14.74 GB
[PB Info 2022-Mar-21 08:04:56] 90.5	 14.10 GB
[PB Info 2022-Mar-21 08:05:06] 90.8	 14.14 GB
[PB Info 2022-Mar-21 08:05:16] 91.1	 14.27 GB
[PB Info 2022-Mar-21 08:05:26] 91.4	 13.97 GB
[PB Info 2022-Mar-21 08:05:36] 91.6	 16.59 GB
[PB Info 2022-Mar-21 08:05:46] 92.0	 15.15 GB
[PB Info 2022-Mar-21 08:05:56] 92.3	 13.97 GB
[PB Info 2022-Mar-21 08:06:06] 92.9	 13.18 GB
[PB Info 2022-Mar-21 08:06:16] 94.5	 11.68 GB
[PB Info 2022-Mar-21 08:06:26] 94.6	 10.81 GB
[PB Info 2022-Mar-21 08:06:36] 95.1	 7.61 GB
[PB Info 2022-Mar-21 08:06:46] 96.1	 5.66 GB
[PB Info 2022-Mar-21 08:06:56] 97.6	 3.79 GB
[PB Info 2022-Mar-21 08:07:06] 98.0	 3.59 GB
[PB Info 2022-Mar-21 08:07:16] 98.1	 0.97 GB
[PB Info 2022-Mar-21 08:07:26] 100.0	 0.00 GB
[PB Info 2022-Mar-21 08:07:26] BQSR and writing final BAM:  3160.201 seconds
[PB Info 2022-Mar-21 08:07:26] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 08:07:26] ||        Program:                          Marking Duplicates, BQSR        ||
[PB Info 2022-Mar-21 08:07:26] ||        Version:                                           3.7.0-1        ||
[PB Info 2022-Mar-21 08:07:26] ||        Start Time:                       Mon Mar 21 07:14:45 2022        ||
[PB Info 2022-Mar-21 08:07:26] ||        End Time:                         Mon Mar 21 08:07:26 2022        ||
[PB Info 2022-Mar-21 08:07:26] ||        Total Time:                          52 minutes 41 seconds        ||
[PB Info 2022-Mar-21 08:07:26] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 08:07:30] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 08:07:30] ||                 Parabricks accelerated Genomics Pipeline                 ||
[PB Info 2022-Mar-21 08:07:30] ||                              Version 3.7.0-1                             ||
[PB Info 2022-Mar-21 08:07:30] ||                         GPU-GATK4 HaplotypeCaller                        ||
[PB Info 2022-Mar-21 08:07:30] ||                  Contact: Parabricks-Support@nvidia.com                  ||
[PB Info 2022-Mar-21 08:07:30] ------------------------------------------------------------------------------
gpg: keyblock resource '/home/ubuntu/.gnupg/pubring.kbx': Permission denied
[PB Info 2022-Mar-21 08:07:58] 0 /workspace/output/output.bam/workspace/output/output.vcf
[PB Info 2022-Mar-21 08:07:58] ProgressMeter -	Current-Locus	Elapsed-Minutes	Regions-Processed	Regions/Minute
[PB Info 2022-Mar-21 08:08:08] chr1:6577807	0.2	36277	217662
[PB Info 2022-Mar-21 08:08:18] chr1:13533551	0.3	74588	223749
[PB Info 2022-Mar-21 08:08:28] chr1:17860640	0.5	100266	200532
[PB Info 2022-Mar-21 08:08:38] chr1:24647735	0.7	140178	210267
[PB Info 2022-Mar-21 08:08:48] chr1:31761347	0.8	178728	214473
[PB Info 2022-Mar-21 08:08:58] chr1:38457496	1.0	215970	215970
[PB Info 2022-Mar-21 08:09:08] chr1:46420606	1.2	259973	222834
[PB Info 2022-Mar-21 08:09:18] chr1:53879955	1.3	299518	224638
[PB Info 2022-Mar-21 08:09:28] chr1:61012747	1.5	340472	226981
[PB Info 2022-Mar-21 08:09:38] chr1:69177510	1.7	387056	232233
[PB Info 2022-Mar-21 08:09:48] chr1:77073581	1.8	430864	235016
[PB Info 2022-Mar-21 08:09:58] chr1:84819127	2.0	475835	237917
[PB Info 2022-Mar-21 08:10:08] chr1:92020631	2.2	516615	238437
[PB Info 2022-Mar-21 08:10:18] chr1:99379028	2.3	558139	239202
[PB Info 2022-Mar-21 08:10:28] chr1:106233587	2.5	598705	239482
[PB Info 2022-Mar-21 08:10:38] chr1:113414260	2.7	638892	239584
[PB Info 2022-Mar-21 08:10:48] chr1:120575984	2.8	678182	239358
[PB Info 2022-Mar-21 08:10:58] chr1:123494194	3.0	696186	232062
[PB Info 2022-Mar-21 08:11:08] chr1:124123121	3.2	701625	221565
[PB Info 2022-Mar-21 08:11:18] chr1:124569378	3.3	705514	211654
[PB Info 2022-Mar-21 08:11:28] chr1:125010963	3.5	709019	202576
[PB Info 2022-Mar-21 08:11:38] chr1:143356795	3.7	711321	193996
[PB Info 2022-Mar-21 08:11:48] chr1:143630252	3.8	712665	185912
[PB Info 2022-Mar-21 08:11:58] chr1:145871903	4.0	721619	180404
[PB Info 2022-Mar-21 08:12:08] chr1:145972639	4.2	722091	173301
[PB Info 2022-Mar-21 08:12:18] chr1:146049418	4.3	722499	166730
[PB Info 2022-Mar-21 08:12:28] chr1:146068560	4.5	722610	160580
[PB Info 2022-Mar-21 08:12:38] chr1:146231906	4.7	723409	155016
[PB Info 2022-Mar-21 08:12:48] chr1:146587002	4.8	724953	149990
[PB Info 2022-Mar-21 08:12:58] chr1:152990175	5.0	759211	151842
[PB Info 2022-Mar-21 08:13:08] chr1:159523191	5.2	796157	154094
[PB Info 2022-Mar-21 08:13:18] chr1:166439767	5.3	836207	156788
[PB Info 2022-Mar-21 08:13:28] chr1:173505326	5.5	876606	159382
[PB Info 2022-Mar-21 08:13:38] chr1:180734328	5.7	917024	161827
[PB Info 2022-Mar-21 08:13:48] chr1:188135725	5.8	957502	164143
[PB Info 2022-Mar-21 08:13:58] chr1:195340676	6.0	999667	166611
[PB Info 2022-Mar-21 08:14:08] chr1:201988670	6.2	1035090	167852
[PB Info 2022-Mar-21 08:14:18] chr1:208170940	6.3	1069696	168899
[PB Info 2022-Mar-21 08:14:28] chr1:214943858	6.5	1108892	170598
[PB Info 2022-Mar-21 08:14:38] chr1:221870308	6.7	1148212	172231
[PB Info 2022-Mar-21 08:14:48] chr1:228081408	6.8	1185287	173456
[PB Info 2022-Mar-21 08:14:58] chr1:234657528	7.0	1223084	174726
[PB Info 2022-Mar-21 08:15:08] chr1:240081313	7.2	1255747	175220
[PB Info 2022-Mar-21 08:15:18] chr1:247790394	7.3	1295010	176592
[PB Info 2022-Mar-21 08:15:28] chr2:5212757	7.5	1330611	177414
[PB Info 2022-Mar-21 08:15:38] chr2:12369532	7.7	1372091	178968
[PB Info 2022-Mar-21 08:15:48] chr2:19593564	7.8	1413438	180438
[PB Info 2022-Mar-21 08:15:58] chr2:27710310	8.0	1457709	182213
[PB Info 2022-Mar-21 08:16:08] chr2:34564769	8.2	1497691	183390
[PB Info 2022-Mar-21 08:16:18] chr2:40449546	8.3	1532518	183902
[PB Info 2022-Mar-21 08:16:28] chr2:47409393	8.5	1573808	185153
[PB Info 2022-Mar-21 08:16:38] chr2:54249478	8.7	1614221	186256
[PB Info 2022-Mar-21 08:16:48] chr2:62164516	8.8	1658573	187762
[PB Info 2022-Mar-21 08:16:58] chr2:69897522	9.0	1701432	189048
[PB Info 2022-Mar-21 08:17:08] chr2:76838161	9.2	1740403	189862
[PB Info 2022-Mar-21 08:17:18] chr2:83697534	9.3	1778657	190570
[PB Info 2022-Mar-21 08:17:28] chr2:91795074	9.5	1815779	191134
[PB Info 2022-Mar-21 08:17:38] chr2:96268686	9.7	1839278	190270
[PB Info 2022-Mar-21 08:17:48] chr2:101961414	9.8	1869976	190167
[PB Info 2022-Mar-21 08:17:58] chr2:109271752	10.0	1911061	191106
[PB Info 2022-Mar-21 08:18:08] chr2:116687901	10.2	1951014	191903
[PB Info 2022-Mar-21 08:18:18] chr2:123527938	10.3	1990346	192614
[PB Info 2022-Mar-21 08:18:28] chr2:131385481	10.5	2034496	193761
[PB Info 2022-Mar-21 08:18:38] chr2:137284776	10.7	2067852	193861
[PB Info 2022-Mar-21 08:18:48] chr2:143394944	10.8	2104402	194252
[PB Info 2022-Mar-21 08:18:58] chr2:151074963	11.0	2146784	195162
[PB Info 2022-Mar-21 08:19:08] chr2:159206147	11.2	2192578	196350
[PB Info 2022-Mar-21 08:19:18] chr2:167443159	11.3	2237927	197464
[PB Info 2022-Mar-21 08:19:28] chr2:173692654	11.5	2274965	197823
[PB Info 2022-Mar-21 08:19:38] chr2:180234929	11.7	2312839	198243
[PB Info 2022-Mar-21 08:19:48] chr2:187089329	11.8	2351114	198685
[PB Info 2022-Mar-21 08:19:58] chr2:194817378	12.0	2395035	199586
[PB Info 2022-Mar-21 08:20:08] chr2:202862324	12.2	2438184	200398
[PB Info 2022-Mar-21 08:20:18] chr2:209750318	12.3	2476699	200813
[PB Info 2022-Mar-21 08:20:28] chr2:215918395	12.5	2511765	200941
[PB Info 2022-Mar-21 08:20:38] chr2:224169398	12.7	2559159	202038
[PB Info 2022-Mar-21 08:20:48] chr2:231940574	12.8	2603385	202861
[PB Info 2022-Mar-21 08:20:58] chr2:238939198	13.0	2643895	203376
[PB Info 2022-Mar-21 08:21:08] chr3:3215935	13.2	2682234	203713
[PB Info 2022-Mar-21 08:21:18] chr3:8769515	13.3	2716873	203765
[PB Info 2022-Mar-21 08:21:28] chr3:15499004	13.5	2754857	204063
[PB Info 2022-Mar-21 08:21:38] chr3:22286289	13.7	2791731	204273
[PB Info 2022-Mar-21 08:21:48] chr3:29846348	13.8	2835306	204961
[PB Info 2022-Mar-21 08:21:58] chr3:37435144	14.0	2877487	205534
[PB Info 2022-Mar-21 08:22:08] chr3:45081505	14.2	2919281	206066
[PB Info 2022-Mar-21 08:22:18] chr3:52507166	14.3	2957568	206341
[PB Info 2022-Mar-21 08:22:28] chr3:59270386	14.5	2997319	206711
[PB Info 2022-Mar-21 08:22:38] chr3:66254139	14.7	3039025	207206
[PB Info 2022-Mar-21 08:22:48] chr3:73113522	14.8	3078838	207562
[PB Info 2022-Mar-21 08:22:58] chr3:78225577	15.0	3108553	207236
[PB Info 2022-Mar-21 08:23:08] chr3:85631923	15.2	3151569	207795
[PB Info 2022-Mar-21 08:23:18] chr3:91569498	15.3	3186574	207820
[PB Info 2022-Mar-21 08:23:28] chr3:98347029	15.5	3219109	207684
[PB Info 2022-Mar-21 08:23:38] chr3:104783733	15.7	3256986	207892
[PB Info 2022-Mar-21 08:23:48] chr3:112090258	15.8	3300102	208427
[PB Info 2022-Mar-21 08:23:58] chr3:119907405	16.0	3343751	208984
[PB Info 2022-Mar-21 08:24:08] chr3:127166160	16.2	3384537	209352
[PB Info 2022-Mar-21 08:24:18] chr3:133732700	16.3	3421771	209496
[PB Info 2022-Mar-21 08:24:28] chr3:141464913	16.5	3464334	209959
[PB Info 2022-Mar-21 08:24:38] chr3:148910329	16.7	3505563	210333
[PB Info 2022-Mar-21 08:24:48] chr3:156292774	16.8	3544612	210571
[PB Info 2022-Mar-21 08:24:58] chr3:163300712	17.0	3584129	210831
[PB Info 2022-Mar-21 08:25:08] chr3:171959898	17.2	3628983	211397
[PB Info 2022-Mar-21 08:25:18] chr3:179265570	17.3	3669563	211705
[PB Info 2022-Mar-21 08:25:28] chr3:186907016	17.5	3710844	212048
[PB Info 2022-Mar-21 08:25:38] chr3:193271708	17.7	3748152	212159
[PB Info 2022-Mar-21 08:25:48] chr4:470384	17.8	3777848	211841
[PB Info 2022-Mar-21 08:25:58] chr4:6513378	18.0	3813252	211847
[PB Info 2022-Mar-21 08:26:08] chr4:11716685	18.2	3845969	211704
[PB Info 2022-Mar-21 08:26:18] chr4:18513456	18.3	3884871	211902
[PB Info 2022-Mar-21 08:26:28] chr4:26543840	18.5	3929110	212384
[PB Info 2022-Mar-21 08:26:38] chr4:32515024	18.7	3964985	212409
[PB Info 2022-Mar-21 08:26:48] chr4:39897547	18.8	4007144	212768
[PB Info 2022-Mar-21 08:26:58] chr4:46545454	19.0	4045609	212926
[PB Info 2022-Mar-21 08:27:08] chr4:49276692	19.2	4061451	211901
[PB Info 2022-Mar-21 08:27:18] chr4:51907046	19.3	4070695	210553
[PB Info 2022-Mar-21 08:27:28] chr4:52094260	19.5	4071693	208804
[PB Info 2022-Mar-21 08:27:38] chr4:53193316	19.7	4077667	207339
[PB Info 2022-Mar-21 08:27:48] chr4:59145567	19.8	4112161	207335
[PB Info 2022-Mar-21 08:27:58] chr4:64627095	20.0	4145346	207267
[PB Info 2022-Mar-21 08:28:08] chr4:72158348	20.2	4187438	207641
[PB Info 2022-Mar-21 08:28:18] chr4:79247960	20.3	4228725	207970
[PB Info 2022-Mar-21 08:28:28] chr4:86337518	20.5	4268571	208222
[PB Info 2022-Mar-21 08:28:38] chr4:93544698	20.7	4307260	208415
[PB Info 2022-Mar-21 08:28:48] chr4:100262375	20.8	4344715	208546
[PB Info 2022-Mar-21 08:28:58] chr4:108353466	21.0	4388625	208982
[PB Info 2022-Mar-21 08:29:08] chr4:114662399	21.2	4425570	209082
[PB Info 2022-Mar-21 08:29:18] chr4:121267087	21.3	4464782	209286
[PB Info 2022-Mar-21 08:29:28] chr4:129436707	21.5	4511192	209822
[PB Info 2022-Mar-21 08:29:38] chr4:135916611	21.7	4549224	209964
[PB Info 2022-Mar-21 08:29:48] chr4:143217444	21.8	4592302	210334
[PB Info 2022-Mar-21 08:29:58] chr4:151247817	22.0	4637213	210782
[PB Info 2022-Mar-21 08:30:08] chr4:157401428	22.2	4671381	210738
[PB Info 2022-Mar-21 08:30:18] chr4:163814325	22.3	4709332	210865
[PB Info 2022-Mar-21 08:30:28] chr4:170308705	22.5	4748193	211030
[PB Info 2022-Mar-21 08:30:38] chr4:176721489	22.7	4785757	211136
[PB Info 2022-Mar-21 08:30:48] chr4:182980761	22.8	4824390	211287
[PB Info 2022-Mar-21 08:30:58] chr4:189306932	23.0	4862249	211402
[PB Info 2022-Mar-21 08:31:08] chr5:2217504	23.2	4875653	210459
[PB Info 2022-Mar-21 08:31:18] chr5:7987187	23.3	4911705	210501
[PB Info 2022-Mar-21 08:31:28] chr5:15119767	23.5	4953335	210780
[PB Info 2022-Mar-21 08:31:38] chr5:22171150	23.7	4994015	211014
[PB Info 2022-Mar-21 08:31:48] chr5:29097412	23.8	5033259	211185
[PB Info 2022-Mar-21 08:31:58] chr5:35524777	24.0	5070474	211269
[PB Info 2022-Mar-21 08:32:08] chr5:42710343	24.2	5110037	211449
[PB Info 2022-Mar-21 08:32:18] chr5:49790307	24.3	5138041	211152
[PB Info 2022-Mar-21 08:32:28] chr5:50135995	24.5	5140803	209828
[PB Info 2022-Mar-21 08:32:38] chr5:52459179	24.7	5153721	208934
[PB Info 2022-Mar-21 08:32:48] chr5:59927849	24.8	5196830	209268
[PB Info 2022-Mar-21 08:32:58] chr5:67003147	25.0	5235525	209421
[PB Info 2022-Mar-21 08:33:08] chr5:76329488	25.2	5278033	209723
[PB Info 2022-Mar-21 08:33:18] chr5:82999225	25.3	5315673	209829
[PB Info 2022-Mar-21 08:33:28] chr5:91411061	25.5	5360845	210229
[PB Info 2022-Mar-21 08:33:38] chr5:99595050	25.7	5404364	210559
[PB Info 2022-Mar-21 08:33:48] chr5:107466934	25.8	5447710	210879
[PB Info 2022-Mar-21 08:33:58] chr5:115281550	26.0	5491938	211228
[PB Info 2022-Mar-21 08:34:08] chr5:123518275	26.2	5537044	211606
[PB Info 2022-Mar-21 08:34:18] chr5:131505568	26.3	5580100	211902
[PB Info 2022-Mar-21 08:34:28] chr5:139953519	26.5	5626007	212302
[PB Info 2022-Mar-21 08:34:38] chr5:147724750	26.7	5667950	212548
[PB Info 2022-Mar-21 08:34:48] chr5:154074958	26.8	5703723	212561
[PB Info 2022-Mar-21 08:34:58] chr5:161635037	27.0	5744916	212774
[PB Info 2022-Mar-21 08:35:08] chr5:168523178	27.2	5784098	212911
[PB Info 2022-Mar-21 08:35:18] chr5:175099179	27.3	5822496	213018
[PB Info 2022-Mar-21 08:35:28] chr6:402940	27.5	5861857	213158
[PB Info 2022-Mar-21 08:35:38] chr6:6134327	27.7	5896478	213125
[PB Info 2022-Mar-21 08:35:48] chr6:12220566	27.8	5932087	213128
[PB Info 2022-Mar-21 08:35:58] chr6:17889575	28.0	5964931	213033
[PB Info 2022-Mar-21 08:36:08] chr6:23351956	28.2	5997679	212935
[PB Info 2022-Mar-21 08:36:18] chr6:34099159	28.3	6038274	213115
[PB Info 2022-Mar-21 08:36:28] chr6:40977505	28.5	6077909	213259
[PB Info 2022-Mar-21 08:36:38] chr6:48076559	28.7	6117909	213415
[PB Info 2022-Mar-21 08:36:48] chr6:54916764	28.8	6158291	213582
[PB Info 2022-Mar-21 08:36:58] chr6:63028708	29.0	6198929	213756
[PB Info 2022-Mar-21 08:37:08] chr6:70670148	29.2	6241518	213994
[PB Info 2022-Mar-21 08:37:18] chr6:77740796	29.3	6281857	214154
[PB Info 2022-Mar-21 08:37:28] chr6:85238162	29.5	6324961	214405
[PB Info 2022-Mar-21 08:37:38] chr6:91583939	29.7	6361736	214440
[PB Info 2022-Mar-21 08:37:48] chr6:98188759	29.8	6400181	214531
[PB Info 2022-Mar-21 08:37:58] chr6:105388531	30.0	6441305	214710
[PB Info 2022-Mar-21 08:38:08] chr6:112579018	30.2	6482358	214884
[PB Info 2022-Mar-21 08:38:18] chr6:120422240	30.3	6526536	215160
[PB Info 2022-Mar-21 08:38:28] chr6:127434929	30.5	6566529	215296
[PB Info 2022-Mar-21 08:38:38] chr6:134918227	30.7	6603960	215346
[PB Info 2022-Mar-21 08:38:48] chr6:143068644	30.8	6647624	215598
[PB Info 2022-Mar-21 08:38:58] chr6:149942244	31.0	6685618	215665
[PB Info 2022-Mar-21 08:39:08] chr6:155860745	31.2	6720524	215631
[PB Info 2022-Mar-21 08:39:18] chr6:162100646	31.3	6757096	215652
[PB Info 2022-Mar-21 08:39:28] chr6:168503756	31.5	6795654	215735
[PB Info 2022-Mar-21 08:39:38] chr7:3907159	31.7	6829471	215667
[PB Info 2022-Mar-21 08:39:48] chr7:10137377	31.8	6867771	215741
[PB Info 2022-Mar-21 08:39:58] chr7:16444740	32.0	6907457	215858
[PB Info 2022-Mar-21 08:40:08] chr7:22598133	32.2	6944532	215892
[PB Info 2022-Mar-21 08:40:18] chr7:29130974	32.3	6981855	215933
[PB Info 2022-Mar-21 08:40:28] chr7:36571119	32.5	7023794	216116
[PB Info 2022-Mar-21 08:40:38] chr7:43430359	32.7	7062175	216189
[PB Info 2022-Mar-21 08:40:48] chr7:49718109	32.8	7098443	216196
[PB Info 2022-Mar-21 08:40:58] chr7:56087990	33.0	7136873	216268
[PB Info 2022-Mar-21 08:41:08] chr7:62443176	33.2	7166277	216068
[PB Info 2022-Mar-21 08:41:18] chr7:67305444	33.3	7196448	215893
[PB Info 2022-Mar-21 08:41:28] chr7:73564544	33.5	7232565	215897
[PB Info 2022-Mar-21 08:41:38] chr7:79977529	33.7	7269139	215915
[PB Info 2022-Mar-21 08:41:48] chr7:87239999	33.8	7311479	216102
[PB Info 2022-Mar-21 08:41:58] chr7:94718213	34.0	7352301	216244
[PB Info 2022-Mar-21 08:42:08] chr7:101155135	34.2	7388475	216248
[PB Info 2022-Mar-21 08:42:18] chr7:107361528	34.3	7423626	216222
[PB Info 2022-Mar-21 08:42:28] chr7:115732616	34.5	7468223	216470
[PB Info 2022-Mar-21 08:42:38] chr7:123566353	34.7	7509978	216633
[PB Info 2022-Mar-21 08:42:48] chr7:131140581	34.8	7552417	216815
[PB Info 2022-Mar-21 08:42:58] chr7:138479825	35.0	7594068	216973
[PB Info 2022-Mar-21 08:43:08] chr7:147244567	35.2	7638340	217203
[PB Info 2022-Mar-21 08:43:18] chr7:153302159	35.3	7672700	217151
[PB Info 2022-Mar-21 08:43:28] chr7:158793485	35.5	7705885	217067
[PB Info 2022-Mar-21 08:43:38] chr8:5846376	35.7	7739464	216994
[PB Info 2022-Mar-21 08:43:48] chr8:11682951	35.8	7775366	216986
[PB Info 2022-Mar-21 08:43:58] chr8:15940744	36.0	7804296	216786
[PB Info 2022-Mar-21 08:44:08] chr8:21234913	36.2	7837968	216718
[PB Info 2022-Mar-21 08:44:18] chr8:27614335	36.3	7875136	216746
[PB Info 2022-Mar-21 08:44:28] chr8:34108773	36.5	7913375	216804
[PB Info 2022-Mar-21 08:44:38] chr8:41980709	36.7	7954761	216948
[PB Info 2022-Mar-21 08:44:48] chr8:50231713	36.8	7995844	217081
[PB Info 2022-Mar-21 08:44:58] chr8:58305559	37.0	8040438	217309
[PB Info 2022-Mar-21 08:45:08] chr8:65740792	37.2	8082140	217456
[PB Info 2022-Mar-21 08:45:18] chr8:72926365	37.3	8120156	217504
[PB Info 2022-Mar-21 08:45:28] chr8:79852781	37.5	8157902	217544
[PB Info 2022-Mar-21 08:45:38] chr8:87484768	37.7	8199136	217676
[PB Info 2022-Mar-21 08:45:48] chr8:95088287	37.8	8240647	217814
[PB Info 2022-Mar-21 08:45:58] chr8:102182177	38.0	8278645	217859
[PB Info 2022-Mar-21 08:46:08] chr8:109569478	38.2	8318392	217949
[PB Info 2022-Mar-21 08:46:18] chr8:117287888	38.3	8359899	218084
[PB Info 2022-Mar-21 08:46:28] chr8:124838269	38.5	8401356	218217
[PB Info 2022-Mar-21 08:46:38] chr8:132038201	38.7	8441226	218307
[PB Info 2022-Mar-21 08:46:48] chr8:138911764	38.8	8482798	218441
[PB Info 2022-Mar-21 08:46:58] chr9:623823	39.0	8519421	218446
[PB Info 2022-Mar-21 08:47:08] chr9:6494384	39.2	8555762	218444
[PB Info 2022-Mar-21 08:47:18] chr9:11951946	39.3	8590142	218393
[PB Info 2022-Mar-21 08:47:28] chr9:18326392	39.5	8628542	218444
[PB Info 2022-Mar-21 08:47:38] chr9:24849532	39.7	8666093	218472
[PB Info 2022-Mar-21 08:47:48] chr9:30787158	39.8	8701420	218445
[PB Info 2022-Mar-21 08:47:58] chr9:36628538	40.0	8735811	218395
[PB Info 2022-Mar-21 08:48:08] chr9:41716745	40.2	8765004	218215
[PB Info 2022-Mar-21 08:48:18] chr9:45297525	40.3	8785706	217827
[PB Info 2022-Mar-21 08:48:28] chr9:65318279	40.5	8808086	217483
[PB Info 2022-Mar-21 08:48:38] chr9:71342300	40.7	8837612	217318
[PB Info 2022-Mar-21 08:48:48] chr9:76977545	40.8	8870040	217225
[PB Info 2022-Mar-21 08:48:58] chr9:84340730	41.0	8911197	217346
[PB Info 2022-Mar-21 08:49:08] chr9:90604794	41.2	8946500	217323
[PB Info 2022-Mar-21 08:49:18] chr9:97511935	41.3	8985743	217397
[PB Info 2022-Mar-21 08:49:28] chr9:105306902	41.5	9027695	217534
[PB Info 2022-Mar-21 08:49:38] chr9:112588546	41.7	9069837	217676
[PB Info 2022-Mar-21 08:49:48] chr9:120172746	41.8	9112748	217834
[PB Info 2022-Mar-21 08:49:58] chr9:127396743	42.0	9152742	217922
[PB Info 2022-Mar-21 08:50:08] chr9:134265534	42.2	9193065	218017
[PB Info 2022-Mar-21 08:50:18] chr10:2035191	42.3	9228966	218007
[PB Info 2022-Mar-21 08:50:28] chr10:7651015	42.5	9264013	217976
[PB Info 2022-Mar-21 08:50:38] chr10:13569480	42.7	9300594	217982
[PB Info 2022-Mar-21 08:50:48] chr10:18830250	42.8	9332757	217885
[PB Info 2022-Mar-21 08:50:58] chr10:26538933	43.0	9374294	218006
[PB Info 2022-Mar-21 08:51:08] chr10:32371097	43.2	9409773	217987
[PB Info 2022-Mar-21 08:51:18] chr10:38491120	43.3	9444918	217959
[PB Info 2022-Mar-21 08:51:28] chr10:42335924	43.5	9464080	217565
[PB Info 2022-Mar-21 08:51:38] chr10:43622139	43.7	9471618	216907
[PB Info 2022-Mar-21 08:51:48] chr10:43708729	43.8	9472206	216095
[PB Info 2022-Mar-21 08:51:58] chr10:43727816	44.0	9472350	215280
[PB Info 2022-Mar-21 08:52:08] chr10:46747183	44.2	9488135	214825
[PB Info 2022-Mar-21 08:52:18] chr10:53462220	44.3	9526769	214889
[PB Info 2022-Mar-21 08:52:28] chr10:60388696	44.5	9567677	215003
[PB Info 2022-Mar-21 08:52:38] chr10:67953578	44.7	9611010	215171
[PB Info 2022-Mar-21 08:52:48] chr10:73977581	44.8	9646111	215154
[PB Info 2022-Mar-21 08:52:58] chr10:80807884	45.0	9683115	215180
[PB Info 2022-Mar-21 08:53:08] chr10:87139101	45.2	9719390	215189
[PB Info 2022-Mar-21 08:53:18] chr10:94032458	45.3	9758248	215255
[PB Info 2022-Mar-21 08:53:28] chr10:100886335	45.5	9796200	215301
[PB Info 2022-Mar-21 08:53:38] chr10:108100794	45.7	9836087	215388
[PB Info 2022-Mar-21 08:53:48] chr10:115526267	45.8	9878754	215536
[PB Info 2022-Mar-21 08:53:58] chr10:121847800	46.0	9916851	215583
[PB Info 2022-Mar-21 08:54:08] chr10:128255752	46.2	9954880	215629
[PB Info 2022-Mar-21 08:54:18] chr11:259131	46.3	9989245	215595
[PB Info 2022-Mar-21 08:54:28] chr11:5423869	46.5	10017436	215428
[PB Info 2022-Mar-21 08:54:38] chr11:10871871	46.7	10049811	215353
[PB Info 2022-Mar-21 08:54:48] chr11:16939152	46.8	10084867	215335
[PB Info 2022-Mar-21 08:54:58] chr11:22535887	47.0	10119135	215300
[PB Info 2022-Mar-21 08:55:08] chr11:28444559	47.2	10155019	215300
[PB Info 2022-Mar-21 08:55:18] chr11:35015974	47.3	10192356	215331
[PB Info 2022-Mar-21 08:55:28] chr11:41927830	47.5	10233094	215433
[PB Info 2022-Mar-21 08:55:38] chr11:49171153	47.7	10274978	215558
[PB Info 2022-Mar-21 08:55:48] chr11:58910199	47.8	10329331	215944
[PB Info 2022-Mar-21 08:55:58] chr11:65697514	48.0	10367133	215981
[PB Info 2022-Mar-21 08:56:08] chr11:71433357	48.2	10399808	215912
[PB Info 2022-Mar-21 08:56:18] chr11:78623898	48.3	10440015	216000
[PB Info 2022-Mar-21 08:56:28] chr11:86327969	48.5	10483605	216156
[PB Info 2022-Mar-21 08:56:38] chr11:92529538	48.7	10520141	216167
[PB Info 2022-Mar-21 08:56:48] chr11:99163190	48.8	10558951	216224
[PB Info 2022-Mar-21 08:56:58] chr11:105200785	49.0	10596079	216246
[PB Info 2022-Mar-21 08:57:08] chr11:113016328	49.2	10640130	216409
[PB Info 2022-Mar-21 08:57:18] chr11:119759970	49.3	10678479	216455
[PB Info 2022-Mar-21 08:57:28] chr11:126057444	49.5	10715341	216471
[PB Info 2022-Mar-21 08:57:38] chr11:133334344	49.7	10756802	216579
[PB Info 2022-Mar-21 08:57:48] chr12:5380655	49.8	10797051	216663
[PB Info 2022-Mar-21 08:57:58] chr12:11707199	50.0	10832228	216644
[PB Info 2022-Mar-21 08:58:08] chr12:17677624	50.2	10866483	216607
[PB Info 2022-Mar-21 08:58:18] chr12:24110295	50.3	10904754	216650
[PB Info 2022-Mar-21 08:58:28] chr12:31060764	50.5	10945632	216745
[PB Info 2022-Mar-21 08:58:38] chr12:37876756	50.7	10984330	216795
[PB Info 2022-Mar-21 08:58:48] chr12:45359840	50.8	11027264	216929
[PB Info 2022-Mar-21 08:58:58] chr12:52511364	51.0	11067634	217012
[PB Info 2022-Mar-21 08:59:08] chr12:60345403	51.2	11110409	217141
[PB Info 2022-Mar-21 08:59:18] chr12:66489497	51.3	11145618	217122
[PB Info 2022-Mar-21 08:59:28] chr12:73113354	51.5	11183722	217159
[PB Info 2022-Mar-21 08:59:38] chr12:80947041	51.7	11227351	217303
[PB Info 2022-Mar-21 08:59:48] chr12:88833574	51.8	11270044	217428
[PB Info 2022-Mar-21 08:59:58] chr12:95817583	52.0	11310577	217511
[PB Info 2022-Mar-21 09:00:08] chr12:103550175	52.2	11353285	217634
[PB Info 2022-Mar-21 09:00:18] chr12:110951994	52.3	11394445	217728
[PB Info 2022-Mar-21 09:00:28] chr12:117767931	52.5	11433421	217779
[PB Info 2022-Mar-21 09:00:38] chr12:123403178	52.7	11466854	217725
[PB Info 2022-Mar-21 09:00:48] chr12:129513555	52.8	11502958	217721
[PB Info 2022-Mar-21 09:00:58] chr13:16391970	53.0	11529573	217539
[PB Info 2022-Mar-21 09:01:08] chr13:17390399	53.2	11539038	217035
[PB Info 2022-Mar-21 09:01:18] chr13:20126250	53.3	11555608	216667
[PB Info 2022-Mar-21 09:01:28] chr13:25387048	53.5	11588596	216609
[PB Info 2022-Mar-21 09:01:38] chr13:31987182	53.7	11627459	216660
[PB Info 2022-Mar-21 09:01:48] chr13:38515006	53.8	11665008	216687
[PB Info 2022-Mar-21 09:01:58] chr13:45983795	54.0	11708354	216821
[PB Info 2022-Mar-21 09:02:08] chr13:52871960	54.2	11747739	216881
[PB Info 2022-Mar-21 09:02:18] chr13:59558268	54.3	11786344	216926
[PB Info 2022-Mar-21 09:02:28] chr13:66762955	54.5	11826598	217001
[PB Info 2022-Mar-21 09:02:38] chr13:73972723	54.7	11868969	217115
[PB Info 2022-Mar-21 09:02:48] chr13:81561301	54.8	11913024	217258
[PB Info 2022-Mar-21 09:02:58] chr13:87777527	55.0	11949126	217256
[PB Info 2022-Mar-21 09:03:08] chr13:94588773	55.2	11988733	217318
[PB Info 2022-Mar-21 09:03:18] chr13:100963058	55.3	12025500	217328
[PB Info 2022-Mar-21 09:03:28] chr13:107673429	55.5	12066100	217407
[PB Info 2022-Mar-21 09:03:38] chr13:112895897	55.7	12096328	217299
[PB Info 2022-Mar-21 09:03:48] chr14:21571044	55.8	12124591	217156
[PB Info 2022-Mar-21 09:03:58] chr14:27710246	56.0	12161133	217163
[PB Info 2022-Mar-21 09:04:08] chr14:35054380	56.2	12203877	217279
[PB Info 2022-Mar-21 09:04:18] chr14:41438258	56.3	12241816	217310
[PB Info 2022-Mar-21 09:04:28] chr14:48167937	56.5	12280489	217353
[PB Info 2022-Mar-21 09:04:38] chr14:55660740	56.7	12324243	217486
[PB Info 2022-Mar-21 09:04:48] chr14:62519708	56.8	12364088	217549
[PB Info 2022-Mar-21 09:04:58] chr14:69820585	57.0	12403961	217613
[PB Info 2022-Mar-21 09:05:08] chr14:76036707	57.2	12439054	217592
[PB Info 2022-Mar-21 09:05:18] chr14:83414224	57.3	12480405	217681
[PB Info 2022-Mar-21 09:05:28] chr14:90355172	57.5	12520430	217746
[PB Info 2022-Mar-21 09:05:38] chr14:97953535	57.7	12555483	217725
[PB Info 2022-Mar-21 09:05:48] chr14:104332797	57.8	12592908	217744
[PB Info 2022-Mar-21 09:05:58] chr15:21590381	58.0	12619095	217570
[PB Info 2022-Mar-21 09:06:08] chr15:22900523	58.2	12625763	217061
[PB Info 2022-Mar-21 09:06:18] chr15:32188580	58.3	12668593	217175
[PB Info 2022-Mar-21 09:06:28] chr15:39115198	58.5	12708156	217233
[PB Info 2022-Mar-21 09:06:38] chr15:47159794	58.7	12750960	217345
[PB Info 2022-Mar-21 09:06:48] chr15:54359841	58.8	12791634	217421
[PB Info 2022-Mar-21 09:06:58] chr15:61036719	59.0	12831850	217488
[PB Info 2022-Mar-21 09:07:08] chr15:68169556	59.2	12870141	217523
[PB Info 2022-Mar-21 09:07:18] chr15:74596751	59.3	12905681	217511
[PB Info 2022-Mar-21 09:07:28] chr15:80615871	59.5	12941121	217497
[PB Info 2022-Mar-21 09:07:38] chr15:88339026	59.7	12982651	217586
[PB Info 2022-Mar-21 09:07:48] chr15:94473360	59.8	13019575	217597
[PB Info 2022-Mar-21 09:07:58] chr15:101423906	60.0	13060696	217678
[PB Info 2022-Mar-21 09:08:08] chr16:5203115	60.2	13093480	217620
[PB Info 2022-Mar-21 09:08:18] chr16:9854246	60.3	13125347	217547
[PB Info 2022-Mar-21 09:08:28] chr16:18105415	60.5	13167733	217648
[PB Info 2022-Mar-21 09:08:38] chr16:25540749	60.7	13208499	217722
[PB Info 2022-Mar-21 09:08:48] chr16:31847826	60.8	13244407	217716
[PB Info 2022-Mar-21 09:08:58] chr16:35087960	61.0	13256835	217325
[PB Info 2022-Mar-21 09:09:08] chr16:46617552	61.2	13269647	216942
[PB Info 2022-Mar-21 09:09:18] chr16:46631972	61.3	13269726	216354
[PB Info 2022-Mar-21 09:09:28] chr16:46636787	61.5	13269753	215768
[PB Info 2022-Mar-21 09:09:38] chr16:46651200	61.7	13269827	215186
[PB Info 2022-Mar-21 09:09:48] chr16:46972627	61.8	13271473	214632
[PB Info 2022-Mar-21 09:09:58] chr16:49070218	62.0	13281255	214213
[PB Info 2022-Mar-21 09:10:08] chr16:49075091	62.2	13281283	213639
[PB Info 2022-Mar-21 09:10:18] chr16:49075091	62.3	13281283	213068
[PB Info 2022-Mar-21 09:10:28] chr16:49094384	62.5	13281436	212502
[PB Info 2022-Mar-21 09:10:38] chr16:49108720	62.7	13281524	211939
[PB Info 2022-Mar-21 09:10:48] chr16:49113512	62.8	13281552	211377
[PB Info 2022-Mar-21 09:10:58] chr16:49118383	63.0	13281585	210818
[PB Info 2022-Mar-21 09:11:08] chr16:49204582	63.2	13282014	210269
[PB Info 2022-Mar-21 09:11:18] chr16:53889520	63.3	13308881	210140
[PB Info 2022-Mar-21 09:11:28] chr16:59563157	63.5	13342101	210111
[PB Info 2022-Mar-21 09:11:38] chr16:66345498	63.7	13379380	210147
[PB Info 2022-Mar-21 09:11:48] chr16:73250413	63.8	13416180	210175
[PB Info 2022-Mar-21 09:11:58] chr16:79411169	64.0	13454373	210224
[PB Info 2022-Mar-21 09:12:08] chr16:84619089	64.2	13488293	210207
[PB Info 2022-Mar-21 09:12:18] chr16:88905474	64.3	13516314	210098
[PB Info 2022-Mar-21 09:12:28] chr17:5231951	64.5	13552029	210108
[PB Info 2022-Mar-21 09:12:38] chr17:10242969	64.7	13582425	210037
[PB Info 2022-Mar-21 09:12:48] chr17:16113550	64.8	13617974	210045
[PB Info 2022-Mar-21 09:12:58] chr17:21820670	65.0	13650076	210001
[PB Info 2022-Mar-21 09:13:08] chr17:24791872	65.2	13662196	209650
[PB Info 2022-Mar-21 09:13:18] chr17:27844693	65.3	13675387	209317
[PB Info 2022-Mar-21 09:13:28] chr17:28262279	65.5	13677413	208815
[PB Info 2022-Mar-21 09:13:38] chr17:33278370	65.7	13702856	208672
[PB Info 2022-Mar-21 09:13:48] chr17:41793439	65.8	13739251	208697
[PB Info 2022-Mar-21 09:13:58] chr17:49915188	66.0	13779212	208775
[PB Info 2022-Mar-21 09:14:08] chr17:55876746	66.2	13813802	208772
[PB Info 2022-Mar-21 09:14:18] chr17:64142379	66.3	13858622	208923
[PB Info 2022-Mar-21 09:14:28] chr17:69654883	66.5	13890710	208882
[PB Info 2022-Mar-21 09:14:38] chr17:75979172	66.7	13925423	208881
[PB Info 2022-Mar-21 09:14:48] chr17:81436633	66.8	13958469	208854
[PB Info 2022-Mar-21 09:14:58] chr18:824369	67.0	13973623	208561
[PB Info 2022-Mar-21 09:15:08] chr18:1516788	67.2	13977641	208103
[PB Info 2022-Mar-21 09:15:18] chr18:7137562	67.3	14011040	208084
[PB Info 2022-Mar-21 09:15:28] chr18:12820669	67.5	14045136	208076
[PB Info 2022-Mar-21 09:15:38] chr18:22953329	67.7	14095924	208314
[PB Info 2022-Mar-21 09:15:48] chr18:29644700	67.8	14132987	208348
[PB Info 2022-Mar-21 09:15:58] chr18:37708602	68.0	14177051	208486
[PB Info 2022-Mar-21 09:16:08] chr18:43854048	68.2	14211465	208481
[PB Info 2022-Mar-21 09:16:18] chr18:50898907	68.3	14249814	208533
[PB Info 2022-Mar-21 09:16:28] chr18:57287811	68.5	14286122	208556
[PB Info 2022-Mar-21 09:16:38] chr18:63479874	68.7	14322469	208579
[PB Info 2022-Mar-21 09:16:48] chr18:70046131	68.8	14362142	208650
[PB Info 2022-Mar-21 09:16:58] chr18:76670276	69.0	14402880	208737
[PB Info 2022-Mar-21 09:17:08] chr19:2615972	69.2	14438271	208746
[PB Info 2022-Mar-21 09:17:18] chr19:7828683	69.3	14470691	208711
[PB Info 2022-Mar-21 09:17:28] chr19:14375991	69.5	14507321	208738
[PB Info 2022-Mar-21 09:17:38] chr19:19967833	69.7	14540805	208719
[PB Info 2022-Mar-21 09:17:48] chr19:28526214	69.8	14572418	208674
[PB Info 2022-Mar-21 09:17:58] chr19:33465405	70.0	14601322	208590
[PB Info 2022-Mar-21 09:18:08] chr19:40118266	70.2	14637615	208612
[PB Info 2022-Mar-21 09:18:18] chr19:46732796	70.3	14673952	208634
[PB Info 2022-Mar-21 09:18:28] chr19:52650996	70.5	14708300	208628
[PB Info 2022-Mar-21 09:18:38] chr20:863992	70.7	14744635	208650
[PB Info 2022-Mar-21 09:18:48] chr20:6897600	70.8	14780601	208667
[PB Info 2022-Mar-21 09:18:58] chr20:12071735	71.0	14810867	208603
[PB Info 2022-Mar-21 09:19:08] chr20:18868289	71.2	14848540	208644
[PB Info 2022-Mar-21 09:19:18] chr20:25502319	71.3	14886127	208684
[PB Info 2022-Mar-21 09:19:28] chr20:29428777	71.5	14903713	208443
[PB Info 2022-Mar-21 09:19:38] chr20:29822356	71.7	14906213	207993
[PB Info 2022-Mar-21 09:19:48] chr20:30566216	71.8	14910850	207575
[PB Info 2022-Mar-21 09:19:58] chr20:32658927	72.0	14920856	207234
[PB Info 2022-Mar-21 09:20:08] chr20:33091182	72.2	14923556	206792
[PB Info 2022-Mar-21 09:20:18] chr20:40267158	72.3	14962076	206848
[PB Info 2022-Mar-21 09:20:28] chr20:47711965	72.5	15003053	206938
[PB Info 2022-Mar-21 09:20:38] chr20:53491165	72.7	15036837	206928
[PB Info 2022-Mar-21 09:20:48] chr20:60436607	72.8	15076393	206998
[PB Info 2022-Mar-21 09:20:58] chr21:8260622	73.0	15104614	206912
[PB Info 2022-Mar-21 09:21:08] chr21:9331194	73.2	15109214	206504
[PB Info 2022-Mar-21 09:21:18] chr21:9604734	73.3	15110169	206047
[PB Info 2022-Mar-21 09:21:28] chr21:9854255	73.5	15112253	205608
[PB Info 2022-Mar-21 09:21:38] chr21:10583898	73.7	15117050	205208
[PB Info 2022-Mar-21 09:21:48] chr21:13051038	73.8	15119956	204784
[PB Info 2022-Mar-21 09:21:58] chr21:13550104	74.0	15123187	204367
[PB Info 2022-Mar-21 09:22:08] chr21:16603091	74.2	15140599	204142
[PB Info 2022-Mar-21 09:22:18] chr21:23318278	74.3	15179415	204207
[PB Info 2022-Mar-21 09:22:28] chr21:29356580	74.5	15215422	204233
[PB Info 2022-Mar-21 09:22:38] chr21:35582378	74.7	15249552	204235
[PB Info 2022-Mar-21 09:22:48] chr21:41831950	74.8	15286669	204276
[PB Info 2022-Mar-21 09:22:58] chr22:11030253	75.0	15316377	204218
[PB Info 2022-Mar-21 09:23:08] chr22:12153359	75.2	15321905	203839
[PB Info 2022-Mar-21 09:23:18] chr22:12369528	75.3	15323252	203406
[PB Info 2022-Mar-21 09:23:28] chr22:15681384	75.5	15329039	203033
[PB Info 2022-Mar-21 09:23:38] chr22:17514978	75.7	15340672	202740
[PB Info 2022-Mar-21 09:23:48] chr22:24571162	75.8	15377513	202780
[PB Info 2022-Mar-21 09:23:58] chr22:31737380	76.0	15417956	202867
[PB Info 2022-Mar-21 09:24:08] chr22:38755099	76.2	15457534	202943
[PB Info 2022-Mar-21 09:24:18] chr22:45547184	76.3	15495700	203000
[PB Info 2022-Mar-21 09:24:28] chr22:50284554	76.5	15524291	202931
[PB Info 2022-Mar-21 09:24:38] chrX:4915151	76.7	15555104	202892
[PB Info 2022-Mar-21 09:24:48] chrX:13583986	76.8	15599728	203033
[PB Info 2022-Mar-21 09:24:58] chrX:23015885	77.0	15645071	203182
[PB Info 2022-Mar-21 09:25:08] chrX:31689495	77.2	15690284	203329
[PB Info 2022-Mar-21 09:25:18] chrX:40430358	77.3	15733910	203455
[PB Info 2022-Mar-21 09:25:28] chrX:48710196	77.5	15776327	203565
[PB Info 2022-Mar-21 09:25:38] chrX:57604753	77.7	15819282	203681
[PB Info 2022-Mar-21 09:25:48] chrX:72234917	77.8	15879936	204024
[PB Info 2022-Mar-21 09:25:58] chrX:81324516	78.0	15927923	204204
[PB Info 2022-Mar-21 09:26:08] chrX:89591967	78.2	15972323	204336
[PB Info 2022-Mar-21 09:26:18] chrX:98764720	78.3	16020895	204522
[PB Info 2022-Mar-21 09:26:28] chrX:108177395	78.5	16065255	204652
[PB Info 2022-Mar-21 09:26:38] chrX:117575726	78.7	16112067	204814
[PB Info 2022-Mar-21 09:26:48] chrX:126643184	78.8	16157511	204957
[PB Info 2022-Mar-21 09:26:58] chrX:137059112	79.0	16207965	205164
[PB Info 2022-Mar-21 09:27:08] chrX:145151881	79.2	16251324	205279
[PB Info 2022-Mar-21 09:27:18] chrX:153801484	79.3	16296090	205412
[PB Info 2022-Mar-21 09:27:28] chrY:11481417	79.5	16336292	205487
[PB Info 2022-Mar-21 09:27:38] chr1_KI270706v1_random:67119	79.7	16366913	205442
[PB Info 2022-Mar-21 09:27:48] chr1_KI270713v1_random:9471	79.8	16370898	205063
[PB Info 2022-Mar-21 09:27:58] chr2_KI270715v1_random:95877	80.0	16371978	204649
[PB Info 2022-Mar-21 09:28:08] chr3_GL000221v1_random:4795	80.2	16373221	204239
[PB Info 2022-Mar-21 09:28:18] chr4_GL000008v2_random:139014	80.3	16375027	203838
[PB Info 2022-Mar-21 09:28:28] chr14_GL000009v2_random:196712	80.5	16380145	203480
[PB Info 2022-Mar-21 09:28:38] chr14_KI270722v1_random:57562	80.7	16382430	203087
[PB Info 2022-Mar-21 09:28:48] chr14_KI270725v1_random:100781	80.8	16386201	202715
[PB Info 2022-Mar-21 09:28:58] chr16_KI270728v1_random:172602	81.0	16387096	202309
[PB Info 2022-Mar-21 09:29:08] chr17_KI270729v1_random:33594	81.2	16392773	201964
[PB Info 2022-Mar-21 09:29:18] chr22_KI270733v1_random:148773	81.3	16397200	201604
[PB Info 2022-Mar-21 09:29:28] chr22_KI270735v1_random:33383	81.5	16398487	201208
[PB Info 2022-Mar-21 09:29:38] chr22_KI270737v1_random:95969	81.7	16400433	200821
[PB Info 2022-Mar-21 09:29:48] chrUn_KI270442v1:23702	81.8	16402170	200433
[PB Info 2022-Mar-21 09:29:58] chrUn_KI270442v1:47956	82.0	16402328	200028
[PB Info 2022-Mar-21 09:30:08] chrUn_KI270442v1:321578	82.2	16404438	199648
[PB Info 2022-Mar-21 09:30:18] chrUn_KI270519v1:52786	82.3	16406748	199272
[PB Info 2022-Mar-21 09:30:28] chrUn_KI270538v1:86165	82.5	16408145	198886
[PB Info 2022-Mar-21 09:30:38] chrUn_GL000195v1:110152	82.7	16410260	198511
[PB Info 2022-Mar-21 09:30:48] chrUn_GL000219v1:38239	82.8	16410899	198119
[PB Info 2022-Mar-21 09:30:58] chrUn_GL000219v1:134282	83.0	16411771	197732
[PB Info 2022-Mar-21 09:31:08] chrUn_GL000219v1:143969	83.2	16411874	197337
[PB Info 2022-Mar-21 09:31:18] chrUn_GL000219v1:172797	83.3	16412129	196945
[PB Info 2022-Mar-21 09:31:28] chrUn_GL000220v1:138979	83.5	16413041	196563
[PB Info 2022-Mar-21 09:31:38] chrUn_KI270743v1:201520	83.7	16416647	196214
[PB Info 2022-Mar-21 09:31:48] chrUn_KI270749v1:38234	83.8	16420461	195870
[PB Info 2022-Mar-21 09:31:58] chrUn_KI270749v1:76791	84.0	16420792	195485
[PB Info 2022-Mar-21 09:32:08] chrUn_KI270753v1:43185	84.2	16423417	195129
[PB Info 2022-Mar-21 09:32:18] chrUn_KI270757v1:28757	84.3	16424541	194757
[PB Info 2022-Mar-21 09:32:28] chrUn_GL000218v1:76778	84.5	16428622	194421
[PB Info 2022-Mar-21 09:32:38] chr1_KI270765v1_alt:143924	84.7	16430780	194064
[PB Info 2022-Mar-21 09:32:48] chr4_GL000257v2_alt:273549	84.8	16438142	193769
[PB Info 2022-Mar-21 09:32:58] chrUn_KN707682v1_decoy:4158	85.0	16571311	194956
[PB Info 2022-Mar-21 09:33:08] chrUn_KN707905v1_decoy:2289	85.2	16575661	194626
[PB Info 2022-Mar-21 09:33:18] chrUn_KN707955v1_decoy:2145	85.3	16576313	194253
[PB Info 2022-Mar-21 09:33:28] chrUn_KN707957v1_decoy:9599	85.5	16576362	193875
[PB Info 2022-Mar-21 09:33:38] chrUn_KN707957v1_decoy:11448	85.7	16576384	193498
[PB Info 2022-Mar-21 09:33:48] chrUn_KN707959v1_decoy:2259	85.8	16576413	193123
[PB Info 2022-Mar-21 09:33:58] chrUn_KN707963v1_decoy:4610	86.0	16576468	192749
[PB Info 2022-Mar-21 09:34:08] chrUn_JTFH01000018v1_decoy:4780	86.2	16578558	192401
[PB Info 2022-Mar-21 09:34:18] chrUn_JTFH01000046v1_decoy:4769	86.3	16579145	192036
[PB Info 2022-Mar-21 09:34:28] chrUn_JTFH01000126v1_decoy:2998	86.5	16580420	191681
[PB Info 2022-Mar-21 09:34:38] chrUn_JTFH01000128v1_decoy:3001	86.7	16580448	191312
[PB Info 2022-Mar-21 09:34:48] chrUn_JTFH01000128v1_decoy:3001	86.8	16580448	190945
[PB Info 2022-Mar-21 09:34:58] chrUn_JTFH01000130v1_decoy:2964	87.0	16580479	190580
[PB Info 2022-Mar-21 09:35:08] chrUn_JTFH01000133v1_decoy:2879	87.2	16580526	190216
[PB Info 2022-Mar-21 09:35:18] chrUn_JTFH01000133v1_decoy:2879	87.3	16580526	189853
[PB Info 2022-Mar-21 09:35:28] chrUn_JTFH01000134v1_decoy:3079	87.5	16580550	189492
[PB Info 2022-Mar-21 09:35:38] chrUn_JTFH01000135v1_decoy:3056	87.7	16580581	189132
[PB Info 2022-Mar-21 09:35:48] chrUn_JTFH01000139v1_decoy:3001	87.8	16580626	188773
[PB Info 2022-Mar-21 09:35:58] chrUn_JTFH01000140v1_decoy:2888	88.0	16580647	188416
[PB Info 2022-Mar-21 09:36:08] chrUn_JTFH01000141v1_decoy:2962	88.2	16580671	188060
[PB Info 2022-Mar-21 09:36:18] chrUn_JTFH01000159v1_decoy:2828	88.3	16580955	187708
[PB Info 2022-Mar-21 09:36:28] chrUn_JTFH01000260v1_decoy:2289	88.5	16582067	187367
[PB Info 2022-Mar-21 09:36:38] chrUn_JTFH01000411v1_decoy:1729	88.7	16583469	187031
[PB Info 2022-Mar-21 09:36:48] chrUn_JTFH01001061v1_decoy:1486	88.8	16588145	186733
[PB Info 2022-Mar-21 09:36:58] chrUn_JTFH01001675v1_decoy:1016	89.0	16592581	186433
[PB Info 2022-Mar-21 09:37:08] chrUn_JTFH01001908v1_decoy:2405	89.2	16596982	186134
[PB Info 2022-Mar-21 09:37:18] HLA-DRB1*15:02:01:10276	89.3	16598422	185803
[PB Info 2022-Mar-21 09:37:30] Total time taken: 5372.039528
[PB Info 2022-Mar-21 09:37:30] ------------------------------------------------------------------------------
[PB Info 2022-Mar-21 09:37:30] ||        Program:                         GPU-GATK4 HaplotypeCaller        ||
[PB Info 2022-Mar-21 09:37:30] ||        Version:                                           3.7.0-1        ||
[PB Info 2022-Mar-21 09:37:30] ||        Start Time:                       Mon Mar 21 08:07:30 2022        ||
[PB Info 2022-Mar-21 09:37:30] ||        End Time:                         Mon Mar 21 09:37:30 2022        ||
[PB Info 2022-Mar-21 09:37:30] ||        Total Time:                           90 minutes 0 seconds        ||
[PB Info 2022-Mar-21 09:37:30] ------------------------------------------------------------------------------

exit code:
Done!
Mon Mar 21 09:37:30 UTC 2022
end_time: 1647855450
Total time: 7h 58m 13s

[1]+  Done                    sh germline.sh 2>&1 | tee germline.sh.log
```
- monitor: program3
    - CPU
        [![](https://i.imgur.com/yWspv7Y.png)](https://i.imgur.com/yWspv7Y.png)
        > CPU 使用 8/8
    - RAM
        ```
        $ free -g; free -m
                      total        used        free      shared  buff/cache   available
        Mem:             30          23           0           0           7           7
        Swap:             0           0           0
                      total        used        free      shared  buff/cache   available
        Mem:          31653       23925         228          12        7498        7262
        Swap:             0           0           0
        ```
        非常吃記憶體，total 30GB 用掉 25GB
        ![](https://i.imgur.com/vIzEIFK.png)
- monitor: program4
    - CPU
        [![](https://i.imgur.com/iBoPk1W.png)](https://i.imgur.com/iBoPk1W.png)
        - nct 應該是用在某個 vCPU 之中，看上面這張圖
        - 一般 1vcpu 通常最多就 2 條執行緒，
            太多的執行緒可能造成過多的 context 切換，不見得有效益
        

