---
# System prepended metadata

title: '[Round 4] appsub controller(spoke) profile'

---

# [Round 4] appsub controller(spoke) profile
Applying 100 git appsub on a 1 hub 1 spoke setting, the 
actual payload is a configmap.

# Time frame
- start deploy:
start time: 2021-02-21 11:56:48.803346 -0500 EST m=+1.316600635

- all deployed:
start time: 2021-02-21 13:00:29.21441 -0500 EST m=+1.278638234

- start  delete:
start time: 2021-02-21 13:24:29.21441 -0500 EST m=+1.278638234

# Time consumption(observed from hub appsub)
![](https://i.imgur.com/3e4Az8b.png)

![](https://i.imgur.com/cNLGRN2.png)


# Node metric
- `container_memory_working_set_bytes`
![](https://i.imgur.com/tjlI5Ot.png)

- rate of `container_cpu_system_seconds_total`
![](https://i.imgur.com/kVh9d29.png)


# go runtime metric
- `"go_memstats.*_inuse_bytes"`
![](https://i.imgur.com/53Vqnhn.png)

- `"process_resident_memory_bytes|go_memstats_alloc_bytes"`

![](https://i.imgur.com/CCDT4l9.png)

- `rate(workqueue_depth[5m])`
![](https://i.imgur.com/CKgrHKG.png)

- `rate(workqueue_adds_total[5m])`
![](https://i.imgur.com/wxMo1ld.png)

- `controller_runtime_reconcile_time_seconds_sum/controller_runtime_reconcile_time_seconds_count`

![](https://i.imgur.com/gknvTtL.png)

# `pprof` zoom in

## Heap
- heap-11-55-06-1613926506
Total: 12.20MB

![](https://i.imgur.com/tlIxXZY.png)

- heap-12-19-13-1613927953
Total: 20.83MB

![](https://i.imgur.com/bhuom1e.png)

- heap-13-25-03-1613931903
Total: 17.83MB
![](https://i.imgur.com/3AdX662.png)

## CPU
- before: profile-11-55-06-1613926506
Total: 30ms
![](https://i.imgur.com/fS6gUzJ.png)

- in-flight: profile-12-01-56-1613926916
Total: 1.59s
![](https://i.imgur.com/816F16e.png)


- in-flight: profile-12-19-13-1613927953
Total: 2.49s
![](https://i.imgur.com/Wy5hK8E.png)

- deletion: profile-13-41-56-1613932916
Total: 90ms
![](https://i.imgur.com/u3z9inf.png)

## goroutine
- goroutine-11-55-06-1613926506
Total: 236

![](https://i.imgur.com/iAOtSfV.png)

- goroutine-12-19-13-1613927953
Total: 222

![](https://i.imgur.com/Qb47tpP.png)

- goroutine-13-41-56-1613932916
Total: 121
![](https://i.imgur.com/9xNGhuX.png)
