# [Round 3] appsub controller(spoke) profile
Applying 100 git appsub on a 1 hub 1 spoke setting, the
actual payload is a configmap.

# Time frame
- start deploy:
start time: 2021-02-19 13:58:27.214117 -0500 EST m=+1.271259103

- all deployed:
start time: 2021-02-19 15:33:50.913518 -0500 EST m=+1.378915386

- start delete:
start time: 2021-02-19 15:45:28.260877 -0500 EST m=+1.325717836

# Time consumption(observed from hub appsub)

# Node metric
- `container_memory_working_set_bytes`


- rate of `container_cpu_system_seconds_total`


# go runtime metric
- `"go_memstats.*_inuse_bytes"`


- `"process_resident_memory_bytes|go_memstats_alloc_bytes"`


- `rate(workqueue_depth[5m])`


- `rate(workqueue_adds_total[5m])`


- `controller_runtime_reconcile_time_seconds_sum/controller_runtime_reconcile_time_seconds_count`


# `pprof` zoom in

## Heap

- heap-13-57-55-1613761075
Total: 18.08MB


- heap-15-09-09-1613765349
Total: 17.70MB

- heap-15-38-45-1613767125
Total: 16.70MB

- heap-15-45-55-1613767555
Total: 17.34MB


## CPU
- before profile-13-57-55-1613761075
Total: 30ms


- in middle 1: profile-15-09-09-1613765349
Total: 1.38s


- post-completion: profile-15-38-45-1613767125
Total: 50ms


- after deletion: profile-16-21-27-1613769687

- `go tool pprof -http=:8989 --diff_base profile-15-12-26-1613765546 profile-15-38-45-1613767125`

## goroutine
- goroutine-13-57-55-1613761075
Total: 118

- goroutine-15-09-09-1613765349
Total: 219


- goroutine-16-21-27-1613769687
Total: 118