HackMD
Benchmarking data
You can setup the benchmarking environment by following this guide.
Config
- Node: 3 e2-custom-2-4096 (2vCPU. 4GB RAM), 1 e2-standard-4 = 4 Node Cluster
- Platform - GKE
- Workload -> Microservices-Demo
- Tool -> Locust Loadgenerator (request at front-end service)
Report for WithoutKubeArmor -
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | AD | CHECKOUT | PRODUCT | RECOMMENDATION | FRONTEND | CART | CURRENCY | LOAD | PAYMENT | REDIS | SHIPPING | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=0, Memory=0 | CPU=0, Memory=0 | 120.70533 | 0 | CPU=45.53655, Memory=184.57031 | CPU=29.56325, Memory=41.621094 | CPU=234.59027, Memory=86.53516 | CPU=239.6684, Memory=474.88672 | CPU=669.37744, Memory=432.39844 | CPU=183.80338, Memory=160.73828 | CPU=251.68547, Memory=264.625 | CPU=9.512445, Memory=201.21875 | CPU=123.59114, Memory=162.33203 | CPU=8.370223, Memory=77.109375 | CPU=15.269382, Memory=7.2890625 | CPU=29.696564, Memory=34.617188 |
Report for WithKubeArmorVisibility - none
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | CURRENCY | LOAD | PAYMENT | FRONTEND | AD | CART | REDIS | SHIPPING | CHECKOUT | PRODUCT | RECOMMENDATION | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=100.09969, Memory=1175.2969 | CPU=20.765556, Memory=83.40625 | 118.669334 | 1.6867486 | CPU=247.06433, Memory=280.98438 | CPU=9.555223, Memory=201.48828 | CPU=127.35264, Memory=164.71094 | CPU=8.79599, Memory=78.18359 | CPU=675.33417, Memory=438.02734 | CPU=44.270336, Memory=186.01172 | CPU=180.61824, Memory=159.84375 | CPU=15.702168, Memory=7.2929688 | CPU=29.931515, Memory=35.84375 | CPU=30.408552, Memory=41.953125 | CPU=227.51378, Memory=88.27344 | CPU=242.94232, Memory=477.41797 |
Report for WithKubeArmorVisibility - process
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | LOAD | RECOMMENDATION | CURRENCY | AD | CART | CHECKOUT | PAYMENT | PRODUCT | REDIS | FRONTEND | SHIPPING | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=96.65451, Memory=1177.0117 | CPU=23.130898, Memory=83.43359 | 120.694664 | 0.008836307 | CPU=127.76708, Memory=165.4375 | CPU=240.54883, Memory=479.41797 | CPU=249.80846, Memory=281.03906 | CPU=46.71881, Memory=187.28906 | CPU=197.36905, Memory=166.74219 | CPU=29.53949, Memory=42.60547 | CPU=9.942176, Memory=201.64062 | CPU=7.7722306, Memory=80.59766 | CPU=225.45273, Memory=87.44141 | CPU=15.874747, Memory=7.3085938 | CPU=678.37683, Memory=441.3125 | CPU=30.000153, Memory=36.191406 |
Report for WithKubeArmorVisibility - process & file
| Users | KUBEARMOR-RELAY | KUBEARMOR | Throughput (req/s) | Percentage Drop | AD | CHECKOUT | CURRENCY | LOAD | PRODUCT | REDIS | SHIPPING | FRONTEND | CART | PAYMENT | RECOMMENDATION | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=24.134466, Memory=85.37891 | CPU=100.31028, Memory=1183.1797 | 124.762 | -3.3608053 | CPU=46.795918, Memory=189.125 | CPU=28.779198, Memory=43.652344 | CPU=253.7612, Memory=284.15625 | CPU=134.88103, Memory=167.17188 | CPU=239.20161, Memory=89.9375 | CPU=15.829008, Memory=7.3242188 | CPU=29.232239, Memory=35.460938 | CPU=686.05023, Memory=439.4453 | CPU=154.97704, Memory=166.80078 | CPU=9.835881, Memory=201.71094 | CPU=8.087306, Memory=84.03516 | CPU=227.01547, Memory=518.5703 |
Report for WithKubeArmorVisibility - process & network
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | PAYMENT | REDIS | SHIPPING | AD | CART | CHECKOUT | CURRENCY | LOAD | PRODUCT | RECOMMENDATION | FRONTEND | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=119.916954, Memory=1179.25 | CPU=37.943745, Memory=90.87109 | 127.683334 | -5.7810245 | CPU=8.346281, Memory=85.44922 | CPU=15.688725, Memory=7.3203125 | CPU=32.28555, Memory=36.070312 | CPU=43.496918, Memory=189.86719 | CPU=172.33492, Memory=167.7539 | CPU=28.350395, Memory=42.066406 | CPU=255.62723, Memory=291.33203 | CPU=9.506696, Memory=201.82031 | CPU=152.57216, Memory=166.38672 | CPU=249.5378, Memory=90.71484 | CPU=207.91621, Memory=473.44922 | CPU=701.61127, Memory=441.0039 |
Report for WithKubeArmorVisibility - process, network & file
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | CURRENCY | PAYMENT | PRODUCT | RECOMMENDATION | REDIS | FRONTEND | CHECKOUT | LOAD | SHIPPING | AD | CART | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=120.87216, Memory=1178.6953 | CPU=32.72215, Memory=91.07422 | 127.83933 | -5.910263 | CPU=253.63814, Memory=286.32422 | CPU=9.846273, Memory=201.8711 | CPU=9.0090275, Memory=86.640625 | CPU=250.30026, Memory=89.97266 | CPU=206.01736, Memory=475.42578 | CPU=15.697701, Memory=7.328125 | CPU=714.92786, Memory=441.6914 | CPU=29.212006, Memory=42.79297 | CPU=141.24632, Memory=170.35938 | CPU=33.239475, Memory=36.078125 | CPU=45.792202, Memory=189.57031 | CPU=163.8436, Memory=168.29297 |
Report for WithKubeArmorPolicy - process
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | PRODUCT | FRONTEND | CART | CHECKOUT | PAYMENT | SHIPPING | AD | CURRENCY | LOAD | RECOMMENDATION | REDIS | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=102.46279, Memory=1184.0508 | CPU=28.476866, Memory=84.56641 | 129.246 | -7.0756383 | CPU=252.97302, Memory=90.45703 | CPU=716.1461, Memory=442.375 | CPU=166.7903, Memory=167.26172 | CPU=31.556221, Memory=43.128906 | CPU=10.323351, Memory=201.9414 | CPU=8.96089, Memory=89.41406 | CPU=32.837154, Memory=35.492188 | CPU=47.75129, Memory=199.96094 | CPU=255.34016, Memory=291.7461 | CPU=153.07176, Memory=168.41016 | CPU=213.70189, Memory=476.15625 | CPU=16.104763, Memory=7.3242188 |
Report for WithKubeArmorPolicy - process & file
| Users | KUBEARMOR | KUBEARMOR-RELAY | Throughput (req/s) | Percentage Drop | LOAD | REDIS | SHIPPING | CHECKOUT | AD | CART | CURRENCY | PAYMENT | PRODUCT | RECOMMENDATION | FRONTEND | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=101.57991, Memory=1186.3555 | CPU=23.656439, Memory=84.76172 | 128.55333 | -6.5017834 | CPU=10.286217, Memory=201.98438 | CPU=138.63326, Memory=169.73828 | CPU=16.167334, Memory=7.3203125 | CPU=31.758776, Memory=35.816406 | CPU=30.608198, Memory=43.86328 | CPU=45.169575, Memory=191.8789 | CPU=178.60297, Memory=167.78516 | CPU=255.97943, Memory=289.1289 | CPU=8.793024, Memory=92.86328 | CPU=252.494, Memory=91.37891 | CPU=207.55217, Memory=477.16406 | CPU=713.3948, Memory=444.3711 |
Report for WithKubeArmorPolicy - process, file and network
| Users | KUBEARMOR-RELAY | KUBEARMOR | Throughput (req/s) | Percentage Drop | REDIS | FRONTEND | CART | CHECKOUT | CURRENCY | PAYMENT | PRODUCT | AD | LOAD | RECOMMENDATION | SHIPPING | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 400 | CPU=24.850195, Memory=84.42578 | CPU=101.61029, Memory=1183.1758 | 128.73866 | -6.655326 | CPU=15.90285, Memory=7.3359375 | CPU=723.1134, Memory=442.60938 | CPU=195.82265, Memory=167.82812 | CPU=31.01716, Memory=43.089844 | CPU=250.1418, Memory=291.5586 | CPU=9.962651, Memory=202.03516 | CPU=8.137586, Memory=90.12891 | CPU=255.99759, Memory=90.71094 | CPU=45.942493, Memory=191.89844 | CPU=146.09703, Memory=169.5625 | CPU=214.81165, Memory=477.91797 | CPU=32.295197, Memory=35.664062 |
