# RERO-ILS : Test de performance des volumes Docker. ## Préambule Ce documents porte sur l'analyse des performances de persistance de données (lecture/ecriture) entre Docker et CEPH (à confirmer?) à l'UCLouvain. ## Objectif Nous allons tester de manière non exhaustive les principaux types de montage docker sur le pool de stockage (ceph?): 1. Layer Docker 2. Volume Docker (default driver) 4. Bind Mount Docker ## Préparation Plusieurs points de montage ont été configurés sur une machine virtuelle: - système de fichier de l'OS (ceph?) - /store-normal - /store-scsi - /store-striped - /store-cachewt - /store-cachewb - /store-ramdisk > **Note:** > hyperviseur ? > OS de la VM: Debian 10 > CPU: 8 vCore > Ram: 48Gb > docker engine: 20.10.6 > postgresql: 12.0 > elasticsearch: 7.12.1 > docker-compose up > clone local du projet rero-ils (v1.2.0) Le test consiste à effectuer pour chaque type de resoures des requêtes en lecture à la base de donnée et à elasticsearch d'une part et des requêtes de reindexation dans elasticsearch d'autre part. Le calcul du temps moyen est basé sur un lot de 100 records par type de ressource A ce stade, le cluster Docker SWARM, n'est pas utilisé. ### Layers Docker Dans cette partie, tous les fichiers créés à l'intérieur d'un conteneur sont stockés sur une couche de conteneur inscriptible en utilisant un pilote de stockage. > **Note:** > Cette abstraction supplémentaire réduit les performances par rapport à l'utilisation de volumes de données, qui écrivent directement sur le système de fichiers hôte. Le dossier `/var/lib/docker` est déplacé sur les files system à profiler. Un lien symbolique est créé vers le montage disque au niveau du répertoire d'instalation docker `/var/lib`. ```bash= $ service docker stop $ cd /varl/lib $ cp -pra docker /store-xxxx/docker $ mv docker docker.old $ ln -s /store-xxxx/docker docker $ service docker start ``` ### docker on os ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.14 get_record_by_id:1.54 validate:1.34 reindex:310.10 search_pid_execute:2.48 search_pid_scan:3.14 es_get:1.49 doc get_record_by_pid:4.26 get_record_by_id:1.78 validate:8.72 reindex:301.18 search_pid_execute:2.77 search_pid_scan:3.44 es_get:1.56 illr get_record_by_pid:4.27 get_record_by_id:1.57 validate:0.85 reindex:278.22 search_pid_execute:2.59 search_pid_scan:3.21 es_get:1.44 item get_record_by_pid:3.66 get_record_by_id:1.58 validate:18.12 reindex:697.52 search_pid_execute:2.21 search_pid_scan:3.12 es_get:1.50 itty get_record_by_pid:4.19 get_record_by_id:1.49 validate:7.84 reindex:252.25 search_pid_execute:2.48 search_pid_scan:3.24 es_get:1.44 hold get_record_by_pid:3.99 get_record_by_id:1.52 validate:13.18 reindex:596.33 search_pid_execute:2.51 search_pid_scan:3.47 es_get:1.37 lofi get_record_by_pid:3.92 get_record_by_id:1.47 validate:0.71 reindex:525.77 search_pid_execute:2.41 search_pid_scan:3.03 es_get:1.37 ptrn get_record_by_pid:4.33 get_record_by_id:1.61 validate:6.51 reindex:257.52 search_pid_execute:2.43 search_pid_scan:3.18 es_get:1.32 pttr get_record_by_pid:4.49 get_record_by_id:1.60 validate:9.35 reindex:255.69 search_pid_execute:2.47 search_pid_scan:3.29 es_get:1.42 ptre get_record_by_pid:4.34 get_record_by_id:1.49 validate:6.99 reindex:227.03 search_pid_execute:2.36 search_pid_scan:3.13 es_get:1.30 ptty get_record_by_pid:4.17 get_record_by_id:1.50 validate:3.91 reindex:246.29 search_pid_execute:2.37 search_pid_scan:3.11 es_get:1.29 org get_record_by_pid:4.34 get_record_by_id:1.57 validate:0.68 reindex:230.85 search_pid_execute:2.41 search_pid_scan:3.19 es_get:1.31 lib get_record_by_pid:4.45 get_record_by_id:1.69 validate:4.87 reindex:249.20 search_pid_execute:2.42 search_pid_scan:3.09 es_get:1.31 loc get_record_by_pid:4.31 get_record_by_id:1.51 validate:10.95 reindex:263.80 search_pid_execute:2.46 search_pid_scan:3.15 es_get:1.36 cont get_record_by_pid:4.52 get_record_by_id:1.69 validate:0.73 reindex:263.34 search_pid_execute:2.83 search_pid_scan:3.52 es_get:1.42 cipo get_record_by_pid:4.32 get_record_by_id:1.64 validate:16.86 reindex:277.07 search_pid_execute:2.47 search_pid_scan:3.37 es_get:1.28 notif get_record_by_pid:4.14 get_record_by_id:1.49 validate:0.64 reindex:239.41 search_pid_execute:2.54 search_pid_scan:3.13 es_get:1.37 vndr get_record_by_pid:4.05 get_record_by_id:1.46 validate:3.94 reindex:252.94 search_pid_execute:2.32 search_pid_scan:3.04 es_get:1.26 acac get_record_by_pid:4.21 get_record_by_id:1.52 validate:6.52 reindex:282.72 search_pid_execute:2.38 search_pid_scan:3.09 es_get:1.29 budg get_record_by_pid:4.42 get_record_by_id:1.58 validate:4.09 reindex:253.21 search_pid_execute:2.63 search_pid_scan:3.35 es_get:1.33 acor acol acin tmpl get_record_by_pid:4.33 get_record_by_id:1.62 validate:6.57 reindex:256.47 search_pid_execute:2.46 search_pid_scan:3.15 es_get:1.37 oplg get_record_by_pid:4.31 get_record_by_id:1.53 validate:0.64 reindex:280.55 search_pid_execute:2.79 search_pid_scan:3.39 es_get:1.32 ``` ### docker on /store-normal ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.27 get_record_by_id:1.59 validate:1.33 reindex:334.17 search_pid_execute:6.30 search_pid_scan:7.38 es_get:2.21 doc get_record_by_pid:4.51 get_record_by_id:1.79 validate:9.03 reindex:331.84 search_pid_execute:4.64 search_pid_scan:5.47 es_get:1.91 illr get_record_by_pid:4.26 get_record_by_id:1.55 validate:0.85 reindex:287.75 search_pid_execute:3.07 search_pid_scan:4.26 es_get:1.71 item get_record_by_pid:3.91 get_record_by_id:1.54 validate:18.36 reindex:736.36 search_pid_execute:2.84 search_pid_scan:3.76 es_get:1.59 itty get_record_by_pid:4.20 get_record_by_id:1.51 validate:8.08 reindex:248.77 search_pid_execute:2.68 search_pid_scan:3.38 es_get:1.49 hold get_record_by_pid:4.02 get_record_by_id:1.51 validate:13.35 reindex:625.68 search_pid_execute:2.93 search_pid_scan:3.76 es_get:1.50 lofi get_record_by_pid:4.03 get_record_by_id:1.52 validate:0.72 reindex:561.08 search_pid_execute:2.61 search_pid_scan:3.28 es_get:1.40 ptrn get_record_by_pid:4.23 get_record_by_id:1.51 validate:5.76 reindex:262.36 search_pid_execute:2.80 search_pid_scan:3.34 es_get:1.44 pttr get_record_by_pid:4.27 get_record_by_id:1.55 validate:8.84 reindex:263.10 search_pid_execute:2.70 search_pid_scan:3.38 es_get:1.46 ptre get_record_by_pid:4.41 get_record_by_id:1.51 validate:6.82 reindex:256.19 search_pid_execute:2.65 search_pid_scan:3.44 es_get:1.36 ptty get_record_by_pid:4.15 get_record_by_id:1.58 validate:3.88 reindex:246.90 search_pid_execute:2.78 search_pid_scan:3.26 es_get:1.34 org get_record_by_pid:4.24 get_record_by_id:1.51 validate:0.64 reindex:236.51 search_pid_execute:2.56 search_pid_scan:3.32 es_get:1.32 lib get_record_by_pid:4.37 get_record_by_id:1.64 validate:4.86 reindex:247.38 search_pid_execute:2.57 search_pid_scan:3.35 es_get:1.38 loc get_record_by_pid:4.27 get_record_by_id:1.49 validate:10.98 reindex:253.68 search_pid_execute:2.42 search_pid_scan:3.17 es_get:1.31 cont get_record_by_pid:4.35 get_record_by_id:1.62 validate:0.76 reindex:273.67 search_pid_execute:2.76 search_pid_scan:3.48 es_get:1.36 cipo get_record_by_pid:4.36 get_record_by_id:1.57 validate:14.90 reindex:241.77 search_pid_execute:2.77 search_pid_scan:3.54 es_get:1.37 notif get_record_by_pid:4.24 get_record_by_id:1.53 validate:0.65 reindex:286.70 search_pid_execute:2.63 search_pid_scan:3.27 es_get:1.31 vndr get_record_by_pid:4.19 get_record_by_id:1.56 validate:4.03 reindex:230.56 search_pid_execute:2.87 search_pid_scan:3.30 es_get:1.33 acac get_record_by_pid:4.20 get_record_by_id:1.49 validate:6.45 reindex:258.79 search_pid_execute:2.57 search_pid_scan:3.28 es_get:1.29 budg get_record_by_pid:4.20 get_record_by_id:1.50 validate:3.87 reindex:235.81 search_pid_execute:2.51 search_pid_scan:3.33 es_get:1.30 acor acol acin tmpl get_record_by_pid:4.30 get_record_by_id:1.59 validate:6.54 reindex:278.68 search_pid_execute:2.55 search_pid_scan:3.43 es_get:1.32 oplg get_record_by_pid:4.34 get_record_by_id:1.52 validate:0.64 reindex:262.34 search_pid_execute:2.50 search_pid_scan:3.31 es_get:1.34 ``` ### docker on /store-scsi ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.30 get_record_by_id:1.57 validate:1.33 reindex:351.12 search_pid_execute:6.30 search_pid_scan:7.41 es_get:2.30 doc get_record_by_pid:4.37 get_record_by_id:1.69 validate:8.30 reindex:331.43 search_pid_execute:4.37 search_pid_scan:5.01 es_get:1.85 illr get_record_by_pid:4.22 get_record_by_id:1.55 validate:0.87 reindex:267.25 search_pid_execute:3.26 search_pid_scan:4.08 es_get:1.68 item get_record_by_pid:3.98 get_record_by_id:1.56 validate:18.37 reindex:743.69 search_pid_execute:2.75 search_pid_scan:3.76 es_get:1.60 itty get_record_by_pid:4.19 get_record_by_id:1.52 validate:8.42 reindex:238.08 search_pid_execute:2.77 search_pid_scan:3.53 es_get:1.46 hold get_record_by_pid:3.92 get_record_by_id:1.52 validate:13.04 reindex:617.89 search_pid_execute:2.86 search_pid_scan:3.50 es_get:1.49 lofi get_record_by_pid:4.10 get_record_by_id:1.55 validate:0.72 reindex:591.73 search_pid_execute:2.70 search_pid_scan:3.47 es_get:1.51 ptrn get_record_by_pid:4.28 get_record_by_id:1.52 validate:6.35 reindex:281.59 search_pid_execute:2.75 search_pid_scan:3.19 es_get:1.37 pttr get_record_by_pid:4.24 get_record_by_id:1.51 validate:8.55 reindex:280.40 search_pid_execute:2.57 search_pid_scan:3.43 es_get:1.39 ptre get_record_by_pid:4.26 get_record_by_id:1.47 validate:6.38 reindex:256.41 search_pid_execute:2.63 search_pid_scan:3.33 es_get:1.32 ptty get_record_by_pid:4.28 get_record_by_id:1.54 validate:4.01 reindex:228.70 search_pid_execute:2.53 search_pid_scan:3.37 es_get:1.39 org get_record_by_pid:4.15 get_record_by_id:1.48 validate:0.65 reindex:244.47 search_pid_execute:2.54 search_pid_scan:3.32 es_get:1.34 lib get_record_by_pid:4.54 get_record_by_id:1.70 validate:4.98 reindex:255.93 search_pid_execute:2.61 search_pid_scan:3.44 es_get:1.43 loc get_record_by_pid:4.20 get_record_by_id:1.47 validate:10.86 reindex:248.47 search_pid_execute:2.56 search_pid_scan:3.21 es_get:1.30 cont get_record_by_pid:4.60 get_record_by_id:1.71 validate:0.74 reindex:266.57 search_pid_execute:2.84 search_pid_scan:3.66 es_get:1.51 cipo get_record_by_pid:4.47 get_record_by_id:1.63 validate:16.98 reindex:253.77 search_pid_execute:2.95 search_pid_scan:3.71 es_get:1.40 notif get_record_by_pid:4.40 get_record_by_id:1.57 validate:0.66 reindex:276.05 search_pid_execute:2.76 search_pid_scan:3.63 es_get:1.40 vndr get_record_by_pid:4.45 get_record_by_id:1.59 validate:4.13 reindex:259.09 search_pid_execute:2.84 search_pid_scan:3.61 es_get:1.38 acac get_record_by_pid:4.34 get_record_by_id:1.58 validate:6.69 reindex:279.78 search_pid_execute:2.72 search_pid_scan:3.46 es_get:1.38 budg get_record_by_pid:4.41 get_record_by_id:1.60 validate:4.08 reindex:240.00 search_pid_execute:2.71 search_pid_scan:3.39 es_get:1.37 acor acol acin tmpl get_record_by_pid:4.38 get_record_by_id:1.66 validate:6.69 reindex:260.80 search_pid_execute:2.66 search_pid_scan:3.42 es_get:1.45 oplg get_record_by_pid:4.36 get_record_by_id:1.56 validate:0.66 reindex:242.35 search_pid_execute:2.59 search_pid_scan:3.35 es_get:1.35 ``` ### docker on /store-striped ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.21 get_record_by_id:1.54 validate:1.29 reindex:387.23 search_pid_execute:6.64 search_pid_scan:7.63 es_get:2.32 doc get_record_by_pid:4.45 get_record_by_id:1.78 validate:9.05 reindex:393.72 search_pid_execute:4.25 search_pid_scan:5.79 es_get:1.90 illr get_record_by_pid:4.08 get_record_by_id:1.51 validate:0.83 reindex:330.15 search_pid_execute:3.08 search_pid_scan:3.86 es_get:1.63 item get_record_by_pid:3.88 get_record_by_id:1.57 validate:18.21 reindex:846.52 search_pid_execute:2.82 search_pid_scan:3.83 es_get:1.59 itty get_record_by_pid:4.41 get_record_by_id:1.60 validate:8.41 reindex:324.26 search_pid_execute:2.84 search_pid_scan:3.62 es_get:1.59 hold get_record_by_pid:4.01 get_record_by_id:1.54 validate:13.28 reindex:718.97 search_pid_execute:2.93 search_pid_scan:3.55 es_get:1.46 lofi get_record_by_pid:4.04 get_record_by_id:1.51 validate:0.71 reindex:651.45 search_pid_execute:2.61 search_pid_scan:3.44 es_get:1.43 ptrn get_record_by_pid:4.24 get_record_by_id:1.55 validate:6.42 reindex:332.17 search_pid_execute:2.63 search_pid_scan:3.40 es_get:1.43 pttr get_record_by_pid:4.15 get_record_by_id:1.52 validate:8.59 reindex:311.32 search_pid_execute:2.66 search_pid_scan:3.29 es_get:1.36 ptre get_record_by_pid:4.49 get_record_by_id:1.58 validate:6.83 reindex:323.85 search_pid_execute:2.70 search_pid_scan:3.48 es_get:1.38 ptty get_record_by_pid:4.39 get_record_by_id:1.61 validate:4.04 reindex:287.75 search_pid_execute:2.69 search_pid_scan:3.65 es_get:1.41 org get_record_by_pid:4.53 get_record_by_id:1.62 validate:0.69 reindex:306.23 search_pid_execute:2.69 search_pid_scan:3.58 es_get:1.44 lib get_record_by_pid:4.51 get_record_by_id:1.72 validate:5.03 reindex:317.96 search_pid_execute:2.77 search_pid_scan:3.50 es_get:1.40 loc get_record_by_pid:4.29 get_record_by_id:1.53 validate:11.02 reindex:331.76 search_pid_execute:2.71 search_pid_scan:3.38 es_get:1.38 cont get_record_by_pid:4.44 get_record_by_id:1.64 validate:0.73 reindex:342.95 search_pid_execute:2.94 search_pid_scan:3.72 es_get:1.54 cipo get_record_by_pid:4.45 get_record_by_id:1.63 validate:15.97 reindex:323.79 search_pid_execute:2.81 search_pid_scan:3.61 es_get:1.43 notif get_record_by_pid:4.19 get_record_by_id:1.52 validate:0.65 reindex:336.86 search_pid_execute:2.53 search_pid_scan:3.44 es_get:1.35 vndr get_record_by_pid:4.31 get_record_by_id:1.58 validate:4.10 reindex:307.69 search_pid_execute:2.71 search_pid_scan:3.50 es_get:1.40 acac get_record_by_pid:4.21 get_record_by_id:1.48 validate:6.35 reindex:319.98 search_pid_execute:2.52 search_pid_scan:3.41 es_get:1.31 budg get_record_by_pid:4.32 get_record_by_id:1.58 validate:4.00 reindex:306.27 search_pid_execute:2.73 search_pid_scan:3.45 es_get:1.38 acor acol acin tmpl get_record_by_pid:4.34 get_record_by_id:1.68 validate:6.57 reindex:362.70 search_pid_execute:2.72 search_pid_scan:3.55 es_get:1.38 oplg get_record_by_pid:4.26 get_record_by_id:1.50 validate:0.64 reindex:320.68 search_pid_execute:2.62 search_pid_scan:3.50 es_get:1.33 ``` ### docker /store-cachewt ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.22 get_record_by_id:1.61 validate:1.31 reindex:338.29 search_pid_execute:2.97 search_pid_scan:3.82 es_get:1.66 doc get_record_by_pid:4.38 get_record_by_id:1.74 validate:8.45 reindex:347.13 search_pid_execute:3.51 search_pid_scan:4.24 es_get:1.69 illr get_record_by_pid:4.22 get_record_by_id:1.57 validate:0.81 reindex:289.77 search_pid_execute:2.85 search_pid_scan:3.74 es_get:1.68 item get_record_by_pid:3.87 get_record_by_id:1.53 validate:18.14 reindex:749.46 search_pid_execute:2.65 search_pid_scan:3.51 es_get:1.52 itty get_record_by_pid:4.30 get_record_by_id:1.54 validate:8.49 reindex:249.77 search_pid_execute:2.71 search_pid_scan:3.52 es_get:1.51 hold get_record_by_pid:4.19 get_record_by_id:1.56 validate:14.34 reindex:638.45 search_pid_execute:3.05 search_pid_scan:3.63 es_get:1.50 lofi get_record_by_pid:4.07 get_record_by_id:1.56 validate:0.74 reindex:549.59 search_pid_execute:2.74 search_pid_scan:3.48 es_get:1.59 ptrn get_record_by_pid:4.41 get_record_by_id:1.57 validate:6.33 reindex:278.23 search_pid_execute:2.66 search_pid_scan:3.58 es_get:1.42 pttr get_record_by_pid:4.41 get_record_by_id:1.59 validate:8.81 reindex:263.58 search_pid_execute:2.69 search_pid_scan:3.70 es_get:1.43 ptre get_record_by_pid:4.45 get_record_by_id:1.54 validate:6.84 reindex:268.36 search_pid_execute:2.66 search_pid_scan:3.46 es_get:1.48 ptty get_record_by_pid:4.22 get_record_by_id:1.56 validate:3.99 reindex:233.07 search_pid_execute:2.51 search_pid_scan:3.37 es_get:1.39 org get_record_by_pid:4.52 get_record_by_id:1.61 validate:0.68 reindex:259.74 search_pid_execute:2.65 search_pid_scan:3.57 es_get:1.53 lib get_record_by_pid:4.61 get_record_by_id:1.76 validate:5.24 reindex:268.57 search_pid_execute:2.73 search_pid_scan:3.61 es_get:1.43 loc get_record_by_pid:4.25 get_record_by_id:1.52 validate:11.11 reindex:257.06 search_pid_execute:2.50 search_pid_scan:3.29 es_get:1.36 cont get_record_by_pid:4.38 get_record_by_id:1.65 validate:0.75 reindex:269.80 search_pid_execute:2.89 search_pid_scan:3.68 es_get:1.42 cipo get_record_by_pid:4.32 get_record_by_id:1.56 validate:14.68 reindex:256.96 search_pid_execute:3.01 search_pid_scan:3.43 es_get:1.35 notif get_record_by_pid:4.28 get_record_by_id:1.54 validate:0.66 reindex:280.55 search_pid_execute:2.58 search_pid_scan:3.32 es_get:1.35 vndr get_record_by_pid:4.28 get_record_by_id:1.57 validate:4.12 reindex:249.00 search_pid_execute:2.56 search_pid_scan:3.72 es_get:1.38 acac get_record_by_pid:4.16 get_record_by_id:1.51 validate:6.50 reindex:257.56 search_pid_execute:2.62 search_pid_scan:3.32 es_get:1.32 budg get_record_by_pid:4.00 get_record_by_id:1.45 validate:3.88 reindex:257.74 search_pid_execute:2.42 search_pid_scan:3.16 es_get:1.30 acor acol acin tmpl get_record_by_pid:4.36 get_record_by_id:1.63 validate:6.76 reindex:268.61 search_pid_execute:2.63 search_pid_scan:3.47 es_get:1.36 oplg get_record_by_pid:4.19 get_record_by_id:1.48 validate:0.64 reindex:244.98 search_pid_execute:2.55 search_pid_scan:3.26 es_get:1.31 ``` ### docker on /store-cachewb ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.46 get_record_by_id:1.62 validate:1.39 reindex:274.58 search_pid_execute:3.64 search_pid_scan:4.39 es_get:1.91 doc get_record_by_pid:4.37 get_record_by_id:1.74 validate:8.58 reindex:294.94 search_pid_execute:3.31 search_pid_scan:4.13 es_get:1.71 illr get_record_by_pid:4.13 get_record_by_id:1.54 validate:0.84 reindex:254.98 search_pid_execute:2.96 search_pid_scan:3.67 es_get:1.62 item get_record_by_pid:3.68 get_record_by_id:1.53 validate:17.99 reindex:691.32 search_pid_execute:2.60 search_pid_scan:3.70 es_get:1.55 itty get_record_by_pid:4.42 get_record_by_id:1.57 validate:8.40 reindex:233.77 search_pid_execute:2.72 search_pid_scan:3.51 es_get:1.51 hold get_record_by_pid:4.13 get_record_by_id:1.57 validate:14.35 reindex:600.71 search_pid_execute:2.86 search_pid_scan:3.61 es_get:1.51 lofi get_record_by_pid:4.01 get_record_by_id:1.53 validate:0.73 reindex:502.83 search_pid_execute:2.80 search_pid_scan:3.33 es_get:1.58 ptrn get_record_by_pid:4.29 get_record_by_id:1.54 validate:6.71 reindex:241.14 search_pid_execute:2.67 search_pid_scan:3.40 es_get:1.38 pttr get_record_by_pid:4.20 get_record_by_id:1.53 validate:8.41 reindex:234.84 search_pid_execute:2.57 search_pid_scan:3.33 es_get:1.33 ptre get_record_by_pid:4.35 get_record_by_id:1.57 validate:6.65 reindex:256.93 search_pid_execute:2.55 search_pid_scan:3.35 es_get:1.34 ptty get_record_by_pid:4.18 get_record_by_id:1.52 validate:3.86 reindex:218.88 search_pid_execute:2.53 search_pid_scan:3.32 es_get:1.34 org get_record_by_pid:4.30 get_record_by_id:1.53 validate:0.65 reindex:228.30 search_pid_execute:2.47 search_pid_scan:3.31 es_get:1.36 lib get_record_by_pid:4.44 get_record_by_id:1.71 validate:4.90 reindex:240.95 search_pid_execute:2.47 search_pid_scan:3.26 es_get:1.32 loc get_record_by_pid:4.22 get_record_by_id:1.50 validate:10.94 reindex:217.20 search_pid_execute:2.55 search_pid_scan:3.15 es_get:1.39 cont get_record_by_pid:4.24 get_record_by_id:1.57 validate:0.71 reindex:238.81 search_pid_execute:2.80 search_pid_scan:3.46 es_get:1.67 cipo get_record_by_pid:4.25 get_record_by_id:1.54 validate:14.51 reindex:230.47 search_pid_execute:2.75 search_pid_scan:3.65 es_get:1.38 notif get_record_by_pid:4.30 get_record_by_id:1.56 validate:0.68 reindex:282.60 search_pid_execute:2.54 search_pid_scan:3.49 es_get:1.37 vndr get_record_by_pid:4.18 get_record_by_id:1.53 validate:4.06 reindex:232.80 search_pid_execute:2.64 search_pid_scan:3.44 es_get:1.37 acac get_record_by_pid:4.14 get_record_by_id:1.46 validate:6.48 reindex:255.65 search_pid_execute:2.56 search_pid_scan:3.25 es_get:1.31 budg get_record_by_pid:4.22 get_record_by_id:1.52 validate:3.97 reindex:203.12 search_pid_execute:2.61 search_pid_scan:3.21 es_get:1.32 acor acol acin tmpl get_record_by_pid:4.41 get_record_by_id:1.66 validate:6.63 reindex:230.72 search_pid_execute:2.94 search_pid_scan:3.61 es_get:1.42 oplg get_record_by_pid:4.40 get_record_by_id:1.54 validate:0.66 reindex:217.97 search_pid_execute:2.70 search_pid_scan:3.41 es_get:1.40 ``` ### docker on /store-ramdisk ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.04 get_record_by_id:1.52 validate:1.30 reindex:80.50 search_pid_execute:2.54 search_pid_scan:3.36 es_get:1.38 doc get_record_by_pid:4.20 get_record_by_id:1.75 validate:8.82 reindex:82.84 search_pid_execute:2.89 search_pid_scan:3.73 es_get:1.39 illr get_record_by_pid:4.13 get_record_by_id:1.53 validate:0.87 reindex:50.52 search_pid_execute:2.68 search_pid_scan:3.38 es_get:1.44 item get_record_by_pid:3.58 get_record_by_id:1.50 validate:17.53 reindex:240.16 search_pid_execute:2.40 search_pid_scan:3.43 es_get:1.50 itty get_record_by_pid:4.13 get_record_by_id:1.55 validate:8.01 reindex:27.67 search_pid_execute:2.45 search_pid_scan:3.26 es_get:1.36 hold get_record_by_pid:3.79 get_record_by_id:1.43 validate:12.45 reindex:152.44 search_pid_execute:2.52 search_pid_scan:3.12 es_get:1.27 lofi get_record_by_pid:3.93 get_record_by_id:1.49 validate:0.72 reindex:110.25 search_pid_execute:2.43 search_pid_scan:3.44 es_get:1.34 ptrn get_record_by_pid:4.10 get_record_by_id:1.45 validate:6.30 reindex:39.48 search_pid_execute:2.42 search_pid_scan:3.21 es_get:1.30 pttr get_record_by_pid:4.05 get_record_by_id:1.48 validate:8.47 reindex:45.90 search_pid_execute:2.38 search_pid_scan:3.15 es_get:1.29 ptre get_record_by_pid:4.15 get_record_by_id:1.46 validate:6.74 reindex:33.34 search_pid_execute:2.62 search_pid_scan:3.39 es_get:1.34 ptty get_record_by_pid:3.95 get_record_by_id:1.44 validate:3.77 reindex:26.43 search_pid_execute:2.41 search_pid_scan:3.09 es_get:1.30 org get_record_by_pid:4.09 get_record_by_id:1.45 validate:0.65 reindex:26.15 search_pid_execute:2.34 search_pid_scan:3.13 es_get:1.29 lib get_record_by_pid:4.25 get_record_by_id:1.65 validate:4.82 reindex:29.71 search_pid_execute:2.42 search_pid_scan:3.33 es_get:1.35 loc get_record_by_pid:4.22 get_record_by_id:1.49 validate:10.92 reindex:30.35 search_pid_execute:2.43 search_pid_scan:3.16 es_get:1.29 cont get_record_by_pid:4.29 get_record_by_id:1.58 validate:0.73 reindex:37.07 search_pid_execute:2.48 search_pid_scan:3.42 es_get:1.37 cipo get_record_by_pid:4.11 get_record_by_id:1.54 validate:15.59 reindex:34.44 search_pid_execute:2.35 search_pid_scan:3.16 es_get:1.27 notif get_record_by_pid:4.01 get_record_by_id:1.50 validate:0.65 reindex:37.59 search_pid_execute:2.30 search_pid_scan:3.16 es_get:1.35 vndr get_record_by_pid:3.93 get_record_by_id:1.42 validate:3.77 reindex:27.50 search_pid_execute:2.46 search_pid_scan:3.20 es_get:1.24 acac get_record_by_pid:4.10 get_record_by_id:1.47 validate:6.37 reindex:29.24 search_pid_execute:2.42 search_pid_scan:3.24 es_get:1.33 budg get_record_by_pid:3.95 get_record_by_id:1.43 validate:3.76 reindex:26.25 search_pid_execute:2.30 search_pid_scan:3.14 es_get:1.29 acor acol acin tmpl get_record_by_pid:4.07 get_record_by_id:1.53 validate:6.23 reindex:33.43 search_pid_execute:2.49 search_pid_scan:3.30 es_get:1.29 oplg get_record_by_pid:4.12 get_record_by_id:1.46 validate:0.64 reindex:25.99 search_pid_execute:2.44 search_pid_scan:3.13 es_get:1.29 ``` ## Volumes Docker Les volumes sont stockés dans une partie du système de fichiers hôte qui est géré par Docker ( sous linux: `/var/lib/docker/volumes/` ). Les processus non-Docker ne doivent pas modifier cette partie du système de fichiers. Les volumes sont le meilleur moyen de conserver les données dans Docker. Un lien symbolique est créé vers le montage disque au niveau du répertoire `volumes` de Docker localisé sur `/var/lib/docker/volumes`. ```bash= $ service docker stop $ cd /var/lib/docker $ cp -pra volumes /store-xxxx/volumes $ mv volumes volumes.old $ ln -s /store-xxxx/volumes volumes $ service docker start ``` point de montage (docker-compose.yml): ```yaml= version: '3.7' services: ... db: ... volumes: - pg-data:/var/lib/postgresql/data es: ... volumes: - es-data:/usr/share/elasticsearch/data ... volumes: pg-data: es-data: ``` ### /store-normal ``` coll get_record_by_pid:4.30 get_record_by_id:1.63 validate:1.34 reindex:299.78 search_pid_execute:2.46 search_pid_scan:3.32 es_get:1.29 doc get_record_by_pid:4.13 get_record_by_id:1.74 validate:8.96 reindex:316.03 search_pid_execute:2.73 search_pid_scan:3.45 es_get:1.43 illr get_record_by_pid:4.13 get_record_by_id:1.54 validate:0.81 reindex:269.68 search_pid_execute:2.45 search_pid_scan:3.30 es_get:1.28 item get_record_by_pid:3.58 get_record_by_id:1.57 validate:18.19 reindex:711.48 search_pid_execute:2.28 search_pid_scan:3.26 es_get:1.30 itty get_record_by_pid:4.15 get_record_by_id:1.51 validate:7.86 reindex:241.11 search_pid_execute:2.44 search_pid_scan:3.15 es_get:1.22 hold get_record_by_pid:4.03 get_record_by_id:1.55 validate:13.19 reindex:622.96 search_pid_execute:2.46 search_pid_scan:3.23 es_get:1.27 lofi get_record_by_pid:4.05 get_record_by_id:1.52 validate:0.69 reindex:547.59 search_pid_execute:2.43 search_pid_scan:3.19 es_get:1.28 ptrn get_record_by_pid:4.14 get_record_by_id:1.50 validate:5.93 reindex:267.01 search_pid_execute:2.48 search_pid_scan:3.30 es_get:1.28 pttr get_record_by_pid:4.17 get_record_by_id:1.54 validate:8.91 reindex:270.18 search_pid_execute:2.41 search_pid_scan:3.20 es_get:1.27 ptre get_record_by_pid:4.26 get_record_by_id:1.50 validate:6.59 reindex:241.15 search_pid_execute:2.45 search_pid_scan:3.17 es_get:1.24 ptty get_record_by_pid:4.16 get_record_by_id:1.58 validate:3.98 reindex:256.33 search_pid_execute:2.34 search_pid_scan:3.25 es_get:1.21 org get_record_by_pid:4.16 get_record_by_id:1.50 validate:0.63 reindex:236.98 search_pid_execute:2.31 search_pid_scan:3.06 es_get:1.24 lib get_record_by_pid:4.40 get_record_by_id:1.71 validate:4.95 reindex:258.02 search_pid_execute:2.52 search_pid_scan:3.24 es_get:1.27 loc get_record_by_pid:4.35 get_record_by_id:1.54 validate:11.14 reindex:255.11 search_pid_execute:2.55 search_pid_scan:3.11 es_get:1.21 cont get_record_by_pid:4.16 get_record_by_id:1.57 validate:0.68 reindex:256.68 search_pid_execute:2.51 search_pid_scan:3.16 es_get:1.21 cipo get_record_by_pid:4.22 get_record_by_id:1.60 validate:16.88 reindex:251.59 search_pid_execute:2.62 search_pid_scan:3.34 es_get:1.27 notif get_record_by_pid:4.15 get_record_by_id:1.48 validate:0.64 reindex:263.47 search_pid_execute:2.37 search_pid_scan:3.10 es_get:1.19 vndr get_record_by_pid:4.22 get_record_by_id:1.56 validate:4.10 reindex:240.04 search_pid_execute:2.44 search_pid_scan:3.24 es_get:1.28 acac get_record_by_pid:4.21 get_record_by_id:1.54 validate:6.55 reindex:241.28 search_pid_execute:2.40 search_pid_scan:3.23 es_get:1.27 budg get_record_by_pid:4.11 get_record_by_id:1.54 validate:3.84 reindex:235.31 search_pid_execute:2.36 search_pid_scan:3.13 es_get:1.20 acor acol acin tmpl get_record_by_pid:4.27 get_record_by_id:1.64 validate:6.63 reindex:258.18 search_pid_execute:2.48 search_pid_scan:3.28 es_get:1.27 oplg get_record_by_pid:4.17 get_record_by_id:1.46 validate:0.62 reindex:241.84 search_pid_execute:2.43 search_pid_scan:3.15 es_get:1.22 ``` ### /store-scsi ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.19 get_record_by_id:1.53 validate:1.29 reindex:444.96 search_pid_execute:6.46 search_pid_scan:7.90 es_get:2.38 doc get_record_by_pid:4.38 get_record_by_id:1.71 validate:8.38 reindex:326.22 search_pid_execute:4.38 search_pid_scan:5.29 es_get:1.85 illr get_record_by_pid:4.22 get_record_by_id:1.52 validate:0.83 reindex:262.81 search_pid_execute:3.30 search_pid_scan:4.03 es_get:1.67 item get_record_by_pid:3.89 get_record_by_id:1.52 validate:18.03 reindex:728.74 search_pid_execute:2.83 search_pid_scan:3.60 es_get:1.53 itty get_record_by_pid:4.21 get_record_by_id:1.54 validate:8.46 reindex:262.16 search_pid_execute:2.69 search_pid_scan:3.48 es_get:1.52 hold get_record_by_pid:3.97 get_record_by_id:1.53 validate:14.04 reindex:622.69 search_pid_execute:2.80 search_pid_scan:3.59 es_get:1.50 lofi get_record_by_pid:4.12 get_record_by_id:1.56 validate:0.73 reindex:574.28 search_pid_execute:2.89 search_pid_scan:3.44 es_get:1.52 ptrn get_record_by_pid:4.22 get_record_by_id:1.53 validate:6.66 reindex:253.98 search_pid_execute:2.66 search_pid_scan:3.41 es_get:1.44 pttr get_record_by_pid:4.20 get_record_by_id:1.51 validate:8.77 reindex:260.56 search_pid_execute:2.61 search_pid_scan:3.45 es_get:1.40 ptre get_record_by_pid:4.28 get_record_by_id:1.51 validate:6.78 reindex:220.21 search_pid_execute:2.51 search_pid_scan:3.27 es_get:1.32 ptty get_record_by_pid:4.07 get_record_by_id:1.47 validate:3.75 reindex:254.14 search_pid_execute:2.42 search_pid_scan:3.13 es_get:1.27 org get_record_by_pid:4.23 get_record_by_id:1.53 validate:0.66 reindex:260.42 search_pid_execute:2.55 search_pid_scan:3.38 es_get:1.34 lib get_record_by_pid:4.36 get_record_by_id:1.64 validate:4.83 reindex:277.58 search_pid_execute:2.51 search_pid_scan:3.26 es_get:1.41 loc get_record_by_pid:4.36 get_record_by_id:1.50 validate:11.21 reindex:272.64 search_pid_execute:2.56 search_pid_scan:3.28 es_get:1.33 cont get_record_by_pid:4.20 get_record_by_id:1.55 validate:0.70 reindex:276.29 search_pid_execute:3.04 search_pid_scan:3.48 es_get:1.32 cipo get_record_by_pid:4.22 get_record_by_id:1.54 validate:15.44 reindex:259.83 search_pid_execute:2.60 search_pid_scan:3.37 es_get:1.35 notif get_record_by_pid:4.28 get_record_by_id:1.53 validate:0.65 reindex:272.12 search_pid_execute:2.58 search_pid_scan:3.54 es_get:1.35 vndr get_record_by_pid:4.23 get_record_by_id:1.53 validate:3.95 reindex:261.37 search_pid_execute:2.50 search_pid_scan:3.25 es_get:1.29 acac get_record_by_pid:4.22 get_record_by_id:1.50 validate:6.46 reindex:286.09 search_pid_execute:2.53 search_pid_scan:3.31 es_get:1.32 budg get_record_by_pid:4.32 get_record_by_id:1.52 validate:3.91 reindex:251.19 search_pid_execute:2.56 search_pid_scan:3.56 es_get:1.36 acor acol acin tmpl get_record_by_pid:4.18 get_record_by_id:1.56 validate:6.38 reindex:262.62 search_pid_execute:2.48 search_pid_scan:3.45 es_get:1.30 oplg get_record_by_pid:4.24 get_record_by_id:1.44 validate:0.64 reindex:244.78 search_pid_execute:2.49 search_pid_scan:3.24 es_get:1.30 ``` ### /store-ramdisk ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.20 get_record_by_id:1.54 validate:1.33 reindex:81.66 search_pid_execute:3.50 search_pid_scan:4.49 es_get:1.72 doc get_record_by_pid:4.39 get_record_by_id:1.73 validate:8.68 reindex:97.73 search_pid_execute:3.60 search_pid_scan:4.54 es_get:1.70 illr get_record_by_pid:4.07 get_record_by_id:1.48 validate:0.81 reindex:51.27 search_pid_execute:3.14 search_pid_scan:3.59 es_get:1.52 item get_record_by_pid:4.07 get_record_by_id:1.54 validate:18.52 reindex:292.25 search_pid_execute:2.78 search_pid_scan:3.58 es_get:1.54 itty get_record_by_pid:4.12 get_record_by_id:1.53 validate:8.17 reindex:27.22 search_pid_execute:2.51 search_pid_scan:3.19 es_get:1.44 hold get_record_by_pid:3.99 get_record_by_id:1.57 validate:12.89 reindex:139.68 search_pid_execute:2.82 search_pid_scan:3.50 es_get:1.40 lofi get_record_by_pid:4.18 get_record_by_id:1.48 validate:0.71 reindex:109.61 search_pid_execute:2.69 search_pid_scan:3.37 es_get:1.43 ptrn get_record_by_pid:4.14 get_record_by_id:1.45 validate:6.54 reindex:40.40 search_pid_execute:2.53 search_pid_scan:3.35 es_get:1.39 pttr get_record_by_pid:4.08 get_record_by_id:1.48 validate:8.73 reindex:46.89 search_pid_execute:2.50 search_pid_scan:3.24 es_get:1.30 ptre get_record_by_pid:4.14 get_record_by_id:1.44 validate:6.67 reindex:31.66 search_pid_execute:2.41 search_pid_scan:3.12 es_get:1.29 ptty get_record_by_pid:4.04 get_record_by_id:1.47 validate:3.75 reindex:26.47 search_pid_execute:2.47 search_pid_scan:3.11 es_get:1.28 org get_record_by_pid:4.13 get_record_by_id:1.44 validate:0.63 reindex:24.81 search_pid_execute:2.38 search_pid_scan:3.14 es_get:1.27 lib get_record_by_pid:4.31 get_record_by_id:1.63 validate:4.81 reindex:28.98 search_pid_execute:2.47 search_pid_scan:3.30 es_get:1.39 loc get_record_by_pid:4.14 get_record_by_id:1.43 validate:10.89 reindex:29.94 search_pid_execute:2.43 search_pid_scan:3.09 es_get:1.31 cont get_record_by_pid:4.41 get_record_by_id:1.69 validate:0.74 reindex:36.55 search_pid_execute:2.65 search_pid_scan:3.82 es_get:1.38 cipo get_record_by_pid:4.29 get_record_by_id:1.57 validate:16.82 reindex:34.71 search_pid_execute:2.67 search_pid_scan:3.46 es_get:1.34 notif get_record_by_pid:4.10 get_record_by_id:1.44 validate:0.64 reindex:37.85 search_pid_execute:2.49 search_pid_scan:3.22 es_get:1.29 vndr get_record_by_pid:3.97 get_record_by_id:1.51 validate:3.89 reindex:27.08 search_pid_execute:2.44 search_pid_scan:3.41 es_get:1.27 acac get_record_by_pid:4.02 get_record_by_id:1.44 validate:6.26 reindex:27.96 search_pid_execute:2.40 search_pid_scan:3.25 es_get:1.31 budg get_record_by_pid:3.95 get_record_by_id:1.43 validate:3.77 reindex:25.90 search_pid_execute:2.34 search_pid_scan:3.12 es_get:1.27 acor acol acin tmpl get_record_by_pid:4.18 get_record_by_id:1.55 validate:6.48 reindex:32.76 search_pid_execute:2.46 search_pid_scan:3.26 es_get:1.55 oplg get_record_by_pid:4.24 get_record_by_id:1.50 validate:0.64 reindex:25.51 search_pid_execute:2.68 search_pid_scan:3.32 es_get:1.29 ``` ## Volumes Docker (bind mount) Les montages de liaison peuvent être stockés n'importe où sur le système hôte. Il peut même s'agir de fichiers ou de répertoires système importants. Les processus non-Docker sur l'hôte Docker ou un conteneur Docker peuvent les modifier à tout moment. ```bash= $ mkdir /store-xxxx/pg-data $ mkdir /store-xxxx/es-data ``` point de montage (docker-compose.yml): ```yaml= version: '3.7' services: ... db: ... volumes: # long syntax exemple - type: bind source: /store-xxxx/pg-data target: /var/lib/postgresql/data es: ... volumes: # short syntax exemple - /store-xxxx/es-data:/usr/share/elasticsearch/data:rw ... ``` ### /store-normal ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.59 get_record_by_id:1.77 validate:1.31 reindex:315.43 search_pid_execute:2.71 search_pid_scan:3.66 es_get:1.51 doc get_record_by_pid:4.68 get_record_by_id:1.90 validate:8.96 reindex:329.84 search_pid_execute:3.32 search_pid_scan:4.01 es_get:1.56 illr get_record_by_pid:4.52 get_record_by_id:1.69 validate:0.87 reindex:269.90 search_pid_execute:2.67 search_pid_scan:3.80 es_get:1.43 item get_record_by_pid:4.52 get_record_by_id:1.75 validate:20.82 reindex:815.95 search_pid_execute:2.85 search_pid_scan:3.84 es_get:1.50 itty get_record_by_pid:4.36 get_record_by_id:1.66 validate:9.05 reindex:262.81 search_pid_execute:2.58 search_pid_scan:3.62 es_get:1.42 hold get_record_by_pid:4.45 get_record_by_id:1.66 validate:14.64 reindex:624.97 search_pid_execute:2.82 search_pid_scan:3.72 es_get:1.43 lofi get_record_by_pid:4.50 get_record_by_id:1.72 validate:0.75 reindex:599.20 search_pid_execute:2.69 search_pid_scan:3.59 es_get:1.46 ptrn get_record_by_pid:4.49 get_record_by_id:1.63 validate:7.06 reindex:279.05 search_pid_execute:2.66 search_pid_scan:3.62 es_get:1.45 pttr get_record_by_pid:4.50 get_record_by_id:1.69 validate:10.19 reindex:268.16 search_pid_execute:2.83 search_pid_scan:3.63 es_get:1.43 ptre get_record_by_pid:4.60 get_record_by_id:1.64 validate:7.89 reindex:260.12 search_pid_execute:2.63 search_pid_scan:3.65 es_get:1.53 ptty get_record_by_pid:4.53 get_record_by_id:1.67 validate:4.38 reindex:259.12 search_pid_execute:2.68 search_pid_scan:3.71 es_get:1.50 org get_record_by_pid:4.78 get_record_by_id:1.84 validate:0.70 reindex:263.49 search_pid_execute:2.82 search_pid_scan:3.86 es_get:1.46 lib get_record_by_pid:4.89 get_record_by_id:1.94 validate:5.50 reindex:264.49 search_pid_execute:2.77 search_pid_scan:3.59 es_get:1.47 loc get_record_by_pid:4.52 get_record_by_id:1.61 validate:12.60 reindex:275.36 search_pid_execute:2.53 search_pid_scan:3.52 es_get:1.38 cont get_record_by_pid:4.40 get_record_by_id:1.71 validate:0.73 reindex:270.96 search_pid_execute:2.60 search_pid_scan:3.70 es_get:1.45 cipo get_record_by_pid:4.42 get_record_by_id:1.67 validate:16.74 reindex:268.88 search_pid_execute:2.64 search_pid_scan:3.87 es_get:1.44 notif get_record_by_pid:4.25 get_record_by_id:1.60 validate:0.66 reindex:286.05 search_pid_execute:2.49 search_pid_scan:3.46 es_get:1.34 vndr get_record_by_pid:4.31 get_record_by_id:1.60 validate:4.21 reindex:262.36 search_pid_execute:2.57 search_pid_scan:3.54 es_get:1.37 acac get_record_by_pid:4.43 get_record_by_id:1.64 validate:7.21 reindex:281.44 search_pid_execute:2.78 search_pid_scan:3.50 es_get:1.40 budg get_record_by_pid:4.34 get_record_by_id:1.56 validate:4.16 reindex:261.88 search_pid_execute:2.52 search_pid_scan:3.44 es_get:1.35 acor acol acin tmpl get_record_by_pid:4.55 get_record_by_id:1.74 validate:7.16 reindex:274.06 search_pid_execute:2.61 search_pid_scan:3.56 es_get:1.43 oplg get_record_by_pid:4.40 get_record_by_id:1.54 validate:0.67 reindex:245.31 search_pid_execute:2.65 search_pid_scan:3.37 es_get:1.31 ``` ### /store-scsi ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.24 get_record_by_id:1.60 validate:1.29 reindex:301.52 search_pid_execute:6.54 search_pid_scan:7.72 es_get:2.29 doc get_record_by_pid:4.40 get_record_by_id:1.77 validate:8.56 reindex:316.83 search_pid_execute:4.19 search_pid_scan:5.47 es_get:2.13 illr get_record_by_pid:4.28 get_record_by_id:1.53 validate:0.84 reindex:261.26 search_pid_execute:3.32 search_pid_scan:3.94 es_get:1.67 item get_record_by_pid:3.87 get_record_by_id:1.62 validate:18.65 reindex:723.63 search_pid_execute:2.80 search_pid_scan:3.68 es_get:1.60 itty get_record_by_pid:4.28 get_record_by_id:1.54 validate:8.35 reindex:239.96 search_pid_execute:2.72 search_pid_scan:3.40 es_get:1.50 hold get_record_by_pid:4.05 get_record_by_id:1.54 validate:12.98 reindex:595.98 search_pid_execute:2.79 search_pid_scan:3.46 es_get:1.52 lofi get_record_by_pid:4.03 get_record_by_id:1.54 validate:0.70 reindex:543.81 search_pid_execute:2.66 search_pid_scan:3.23 es_get:1.44 ptrn get_record_by_pid:4.26 get_record_by_id:1.52 validate:6.11 reindex:255.69 search_pid_execute:2.60 search_pid_scan:3.36 es_get:1.46 pttr get_record_by_pid:4.21 get_record_by_id:1.53 validate:8.90 reindex:261.19 search_pid_execute:2.70 search_pid_scan:3.48 es_get:1.47 ptre get_record_by_pid:4.42 get_record_by_id:1.54 validate:7.20 reindex:244.30 search_pid_execute:2.65 search_pid_scan:3.41 es_get:1.40 ptty get_record_by_pid:4.24 get_record_by_id:1.53 validate:3.98 reindex:233.71 search_pid_execute:2.62 search_pid_scan:3.43 es_get:1.38 org get_record_by_pid:4.33 get_record_by_id:1.52 validate:0.65 reindex:234.51 search_pid_execute:2.60 search_pid_scan:3.41 es_get:1.38 lib get_record_by_pid:4.59 get_record_by_id:1.69 validate:4.99 reindex:226.70 search_pid_execute:2.58 search_pid_scan:3.43 es_get:1.41 loc get_record_by_pid:4.58 get_record_by_id:1.65 validate:12.30 reindex:240.63 search_pid_execute:2.73 search_pid_scan:3.64 es_get:1.45 cont get_record_by_pid:5.03 get_record_by_id:2.07 validate:0.82 reindex:269.54 search_pid_execute:3.42 search_pid_scan:4.51 es_get:1.71 cipo get_record_by_pid:5.42 get_record_by_id:2.09 validate:21.28 reindex:301.39 search_pid_execute:3.39 search_pid_scan:5.06 es_get:1.72 notif get_record_by_pid:5.18 get_record_by_id:1.94 validate:0.71 reindex:279.40 search_pid_execute:3.27 search_pid_scan:4.38 es_get:1.65 vndr get_record_by_pid:5.06 get_record_by_id:1.95 validate:4.99 reindex:278.79 search_pid_execute:3.34 search_pid_scan:4.51 es_get:1.67 acac get_record_by_pid:4.80 get_record_by_id:1.82 validate:7.78 reindex:261.36 search_pid_execute:2.95 search_pid_scan:4.07 es_get:1.51 budg get_record_by_pid:4.58 get_record_by_id:1.76 validate:4.46 reindex:246.54 search_pid_execute:3.12 search_pid_scan:4.14 es_get:1.53 acor acol acin tmpl get_record_by_pid:4.75 get_record_by_id:1.85 validate:7.70 reindex:275.22 search_pid_execute:2.87 search_pid_scan:4.05 es_get:1.53 oplg get_record_by_pid:5.19 get_record_by_id:1.87 validate:0.70 reindex:281.02 search_pid_execute:3.01 search_pid_scan:4.17 es_get:1.61 ``` ### /store-striped ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.32 get_record_by_id:1.58 validate:1.34 reindex:346.84 search_pid_execute:2.79 search_pid_scan:3.66 es_get:1.59 doc get_record_by_pid:4.57 get_record_by_id:1.82 validate:8.36 reindex:397.42 search_pid_execute:3.13 search_pid_scan:4.05 es_get:1.66 illr get_record_by_pid:4.32 get_record_by_id:1.57 validate:0.83 reindex:342.16 search_pid_execute:2.78 search_pid_scan:3.63 es_get:1.54 item get_record_by_pid:3.97 get_record_by_id:1.59 validate:18.41 reindex:837.77 search_pid_execute:2.53 search_pid_scan:3.41 es_get:1.46 itty get_record_by_pid:4.17 get_record_by_id:1.50 validate:7.72 reindex:268.51 search_pid_execute:2.60 search_pid_scan:3.19 es_get:1.37 hold get_record_by_pid:3.91 get_record_by_id:1.53 validate:12.82 reindex:713.12 search_pid_execute:2.63 search_pid_scan:3.38 es_get:1.38 lofi get_record_by_pid:4.06 get_record_by_id:1.56 validate:0.71 reindex:629.53 search_pid_execute:2.46 search_pid_scan:3.25 es_get:1.49 ptrn get_record_by_pid:4.47 get_record_by_id:1.61 validate:6.40 reindex:318.91 search_pid_execute:2.60 search_pid_scan:3.44 es_get:1.44 pttr get_record_by_pid:4.44 get_record_by_id:1.62 validate:9.26 reindex:312.02 search_pid_execute:2.53 search_pid_scan:3.31 es_get:1.42 ptre get_record_by_pid:4.59 get_record_by_id:1.65 validate:7.73 reindex:278.37 search_pid_execute:2.69 search_pid_scan:3.55 es_get:1.47 ptty get_record_by_pid:4.51 get_record_by_id:1.64 validate:4.16 reindex:306.78 search_pid_execute:2.64 search_pid_scan:3.51 es_get:1.47 org get_record_by_pid:4.18 get_record_by_id:1.49 validate:0.66 reindex:283.36 search_pid_execute:2.39 search_pid_scan:3.28 es_get:1.39 lib get_record_by_pid:4.50 get_record_by_id:1.70 validate:4.93 reindex:288.21 search_pid_execute:2.56 search_pid_scan:3.59 es_get:1.39 loc get_record_by_pid:4.45 get_record_by_id:1.57 validate:11.23 reindex:301.27 search_pid_execute:2.56 search_pid_scan:3.63 es_get:1.40 cont get_record_by_pid:4.79 get_record_by_id:1.81 validate:0.78 reindex:305.61 search_pid_execute:3.31 search_pid_scan:3.97 es_get:1.56 cipo get_record_by_pid:4.32 get_record_by_id:1.61 validate:15.94 reindex:284.17 search_pid_execute:2.65 search_pid_scan:3.51 es_get:1.39 notif get_record_by_pid:4.22 get_record_by_id:1.52 validate:0.64 reindex:297.10 search_pid_execute:2.50 search_pid_scan:3.36 es_get:1.33 vndr get_record_by_pid:4.38 get_record_by_id:1.59 validate:4.13 reindex:307.23 search_pid_execute:2.73 search_pid_scan:3.66 es_get:1.38 acac get_record_by_pid:4.29 get_record_by_id:1.53 validate:6.57 reindex:314.55 search_pid_execute:2.74 search_pid_scan:3.38 es_get:1.36 budg get_record_by_pid:4.36 get_record_by_id:1.62 validate:4.10 reindex:285.37 search_pid_execute:2.78 search_pid_scan:3.33 es_get:1.37 acor acol acin tmpl get_record_by_pid:4.44 get_record_by_id:1.66 validate:6.68 reindex:303.71 search_pid_execute:2.71 search_pid_scan:3.67 es_get:1.41 oplg get_record_by_pid:4.32 get_record_by_id:1.48 validate:0.65 reindex:281.62 search_pid_execute:2.82 search_pid_scan:3.36 es_get:1.34 ``` ### /store-ramdisk ``` =========== Perfs in ms per request ======== coll get_record_by_pid:4.17 get_record_by_id:1.56 validate:1.32 reindex:79.69 search_pid_execute:2.45 search_pid_scan:3.29 es_get:1.34 doc get_record_by_pid:4.26 get_record_by_id:1.75 validate:8.98 reindex:81.72 search_pid_execute:2.74 search_pid_scan:3.66 es_get:1.35 illr get_record_by_pid:4.19 get_record_by_id:1.53 validate:0.83 reindex:46.63 search_pid_execute:2.39 search_pid_scan:3.15 es_get:1.25 item get_record_by_pid:3.67 get_record_by_id:1.53 validate:18.11 reindex:224.60 search_pid_execute:2.27 search_pid_scan:3.20 es_get:1.36 itty get_record_by_pid:3.97 get_record_by_id:1.46 validate:7.62 reindex:22.94 search_pid_execute:2.30 search_pid_scan:3.09 es_get:1.22 hold get_record_by_pid:4.00 get_record_by_id:1.49 validate:12.88 reindex:138.50 search_pid_execute:2.51 search_pid_scan:3.18 es_get:1.26 lofi get_record_by_pid:3.93 get_record_by_id:1.47 validate:0.71 reindex:97.52 search_pid_execute:2.41 search_pid_scan:3.13 es_get:1.40 ptrn get_record_by_pid:4.09 get_record_by_id:1.52 validate:6.40 reindex:37.22 search_pid_execute:2.48 search_pid_scan:3.26 es_get:1.32 pttr get_record_by_pid:4.03 get_record_by_id:1.45 validate:8.33 reindex:41.52 search_pid_execute:2.35 search_pid_scan:3.10 es_get:1.40 ptre get_record_by_pid:4.24 get_record_by_id:1.48 validate:7.12 reindex:29.73 search_pid_execute:2.38 search_pid_scan:3.30 es_get:1.32 ptty get_record_by_pid:3.98 get_record_by_id:1.47 validate:3.82 reindex:24.38 search_pid_execute:2.40 search_pid_scan:3.21 es_get:1.28 org get_record_by_pid:4.14 get_record_by_id:1.49 validate:0.65 reindex:21.11 search_pid_execute:2.46 search_pid_scan:3.13 es_get:1.24 lib get_record_by_pid:4.33 get_record_by_id:1.65 validate:4.76 reindex:24.50 search_pid_execute:2.35 search_pid_scan:3.18 es_get:1.24 loc get_record_by_pid:4.08 get_record_by_id:1.48 validate:10.99 reindex:26.97 search_pid_execute:2.78 search_pid_scan:3.32 es_get:1.30 cont get_record_by_pid:4.31 get_record_by_id:1.60 validate:0.73 reindex:30.77 search_pid_execute:2.65 search_pid_scan:3.24 es_get:1.26 cipo get_record_by_pid:4.21 get_record_by_id:1.56 validate:14.28 reindex:30.06 search_pid_execute:2.40 search_pid_scan:3.19 es_get:1.24 notif get_record_by_pid:4.03 get_record_by_id:1.49 validate:0.64 reindex:34.40 search_pid_execute:2.35 search_pid_scan:3.09 es_get:1.21 vndr get_record_by_pid:4.09 get_record_by_id:1.49 validate:3.92 reindex:24.92 search_pid_execute:2.36 search_pid_scan:3.20 es_get:1.25 acac get_record_by_pid:4.06 get_record_by_id:1.50 validate:6.45 reindex:25.34 search_pid_execute:2.39 search_pid_scan:3.34 es_get:1.27 budg get_record_by_pid:4.23 get_record_by_id:1.65 validate:4.04 reindex:23.82 search_pid_execute:2.68 search_pid_scan:3.32 es_get:1.29 acor acol acin tmpl get_record_by_pid:4.25 get_record_by_id:1.55 validate:6.36 reindex:30.15 search_pid_execute:2.71 search_pid_scan:3.30 es_get:1.33 oplg get_record_by_pid:3.95 get_record_by_id:1.44 validate:0.63 reindex:22.55 search_pid_execute:2.36 search_pid_scan:3.34 es_get:1.18 ``` ## Base de comparaison ### iMac local-dev (hybrid HDD) ``` =========== Perfs in ms per request ======== coll get_record_by_pid:5.26 get_record_by_id:2.50 validate:1.17 reindex:136.12 search_pid_execute:3.86 search_pid_scan:5.41 es_get:2.49 doc get_record_by_pid:5.38 get_record_by_id:2.68 validate:12.51 reindex:129.17 search_pid_execute:3.68 search_pid_scan:8.61 es_get:2.75 illr get_record_by_pid:5.42 get_record_by_id:2.64 validate:1.05 reindex:95.67 search_pid_execute:3.53 search_pid_scan:5.47 es_get:2.44 item get_record_by_pid:5.11 get_record_by_id:2.49 validate:23.91 reindex:299.81 search_pid_execute:3.56 search_pid_scan:5.41 es_get:2.48 itty get_record_by_pid:5.53 get_record_by_id:2.73 validate:13.89 reindex:58.16 search_pid_execute:3.77 search_pid_scan:6.00 es_get:2.47 hold get_record_by_pid:5.61 get_record_by_id:2.72 validate:19.24 reindex:254.56 search_pid_execute:3.87 search_pid_scan:6.40 es_get:2.62 lofi get_record_by_pid:5.43 get_record_by_id:2.62 validate:0.93 reindex:242.86 search_pid_execute:3.59 search_pid_scan:5.67 es_get:2.57 ptrn get_record_by_pid:5.66 get_record_by_id:2.64 validate:9.17 reindex:81.78 search_pid_execute:3.87 search_pid_scan:5.82 es_get:2.59 pttr get_record_by_pid:4.99 get_record_by_id:2.37 validate:11.15 reindex:80.15 search_pid_execute:3.71 search_pid_scan:5.46 es_get:2.24 ptre get_record_by_pid:4.87 get_record_by_id:2.27 validate:7.73 reindex:57.26 search_pid_execute:3.17 search_pid_scan:5.14 es_get:2.15 ptty get_record_by_pid:4.64 get_record_by_id:2.23 validate:4.12 reindex:51.75 search_pid_execute:3.06 search_pid_scan:4.90 es_get:2.01 org get_record_by_pid:4.77 get_record_by_id:2.25 validate:0.58 reindex:44.23 search_pid_execute:3.07 search_pid_scan:5.11 es_get:2.23 lib get_record_by_pid:5.45 get_record_by_id:2.71 validate:5.46 reindex:55.22 search_pid_execute:3.50 search_pid_scan:5.70 es_get:2.43 loc get_record_by_pid:5.03 get_record_by_id:2.31 validate:14.98 reindex:55.51 search_pid_execute:3.17 search_pid_scan:5.17 es_get:2.22 cont get_record_by_pid:5.09 get_record_by_id:2.54 validate:0.60 reindex:66.35 search_pid_execute:3.37 search_pid_scan:5.48 es_get:2.33 cipo get_record_by_pid:4.76 get_record_by_id:2.33 validate:24.09 reindex:56.54 search_pid_execute:3.21 search_pid_scan:4.86 es_get:2.07 notif get_record_by_pid:4.91 get_record_by_id:2.35 validate:0.62 reindex:68.00 search_pid_execute:3.36 search_pid_scan:5.31 es_get:2.29 vndr get_record_by_pid:4.77 get_record_by_id:2.30 validate:4.22 reindex:50.34 search_pid_execute:3.24 search_pid_scan:5.22 es_get:2.15 acac get_record_by_pid:4.83 get_record_by_id:2.30 validate:7.42 reindex:53.29 search_pid_execute:3.22 search_pid_scan:5.31 es_get:2.06 budg get_record_by_pid:5.06 get_record_by_id:2.49 validate:4.38 reindex:52.65 search_pid_execute:3.10 search_pid_scan:5.30 es_get:2.45 acor acol acin tmpl get_record_by_pid:4.98 get_record_by_id:2.43 validate:8.36 reindex:60.48 search_pid_execute:3.28 search_pid_scan:5.06 es_get:2.61 oplg get_record_by_pid:5.24 get_record_by_id:2.50 validate:0.64 reindex:56.60 search_pid_execute:3.77 search_pid_scan:5.46 es_get:2.29 ``` ### Kubernetes @ ReRo ReRo dispose de plusieurs cluster Kubernetes hebergés sur une infrastructure virtualisé VMware (version 6.7). Ils utilisent un storage Dell SC3020 (SSD) connecté en Fibre optique aux hyperviseurs ``` RERO kubernetes dev2 ------------------------------ coll get_record_by_pid:4.15 get_record_by_id:1.63 validate:1.36 reindex:141.86 search_pid_execute:5.80 search_pid_scan:10.10 es_get:2.47 doc get_record_by_pid:4.84 get_record_by_id:1.99 validate:11.61 reindex:172.84 search_pid_execute:6.82 search_pid_scan:12.85 es_get:3.60 illr get_record_by_pid:4.20 get_record_by_id:1.75 validate:0.79 reindex:114.40 search_pid_execute:6.72 search_pid_scan:10.99 es_get:3.01 item get_record_by_pid:4.20 get_record_by_id:1.57 validate:18.21 reindex:469.60 search_pid_execute:5.80 search_pid_scan:9.57 es_get:2.46 itty get_record_by_pid:4.13 get_record_by_id:1.52 validate:15.04 reindex:82.45 search_pid_execute:6.12 search_pid_scan:8.93 es_get:2.41 hold get_record_by_pid:4.02 get_record_by_id:1.51 validate:13.53 reindex:269.63 search_pid_execute:5.70 search_pid_scan:9.36 es_get:2.28 lofi get_record_by_pid:4.15 get_record_by_id:1.64 validate:0.74 reindex:332.42 search_pid_execute:5.45 search_pid_scan:9.13 es_get:2.46 ptrn get_record_by_pid:4.05 get_record_by_id:1.50 validate:6.72 reindex:100.68 search_pid_execute:5.80 search_pid_scan:9.39 es_get:3.74 pttr get_record_by_pid:3.98 get_record_by_id:1.55 validate:8.53 reindex:97.41 search_pid_execute:5.54 search_pid_scan:10.08 es_get:2.44 ptre get_record_by_pid:4.21 get_record_by_id:1.51 validate:6.47 reindex:95.84 search_pid_execute:5.62 search_pid_scan:10.59 es_get:2.81 ptty get_record_by_pid:3.81 get_record_by_id:1.46 validate:3.67 reindex:83.42 search_pid_execute:5.62 search_pid_scan:10.20 es_get:2.48 org get_record_by_pid:4.02 get_record_by_id:1.49 validate:0.59 reindex:77.74 search_pid_execute:5.43 search_pid_scan:9.58 es_get:2.56 lib get_record_by_pid:4.30 get_record_by_id:1.72 validate:4.75 reindex:86.11 search_pid_execute:5.26 search_pid_scan:8.74 es_get:2.35 loc get_record_by_pid:4.05 get_record_by_id:1.50 validate:16.96 reindex:84.00 search_pid_execute:5.67 search_pid_scan:9.12 es_get:2.07 cont get_record_by_pid:4.19 get_record_by_id:1.68 validate:0.69 reindex:102.16 search_pid_execute:5.84 search_pid_scan:8.78 es_get:2.32 cipo get_record_by_pid:4.22 get_record_by_id:1.63 validate:15.28 reindex:85.93 search_pid_execute:5.39 search_pid_scan:8.82 es_get:2.04 notif get_record_by_pid:3.99 get_record_by_id:1.50 validate:0.59 reindex:93.48 search_pid_execute:5.04 search_pid_scan:8.97 es_get:2.33 vndr get_record_by_pid:4.07 get_record_by_id:1.52 validate:3.98 reindex:84.23 search_pid_execute:5.13 search_pid_scan:8.56 es_get:2.31 acac get_record_by_pid:4.15 get_record_by_id:1.48 validate:6.22 reindex:80.93 search_pid_execute:4.82 search_pid_scan:8.58 es_get:2.25 budg get_record_by_pid:4.04 get_record_by_id:1.56 validate:3.79 reindex:78.77 search_pid_execute:5.58 search_pid_scan:9.14 es_get:2.16 acor get_record_by_pid:4.06 get_record_by_id:1.59 validate:9.52 reindex:80.81 search_pid_execute:4.79 search_pid_scan:9.63 es_get:2.04 acol get_record_by_pid:3.62 get_record_by_id:1.65 validate:12.12 reindex:198.23 search_pid_execute:4.94 search_pid_scan:8.32 es_get:2.18 acin tmpl get_record_by_pid:4.12 get_record_by_id:1.71 validate:6.41 reindex:90.42 search_pid_execute:6.21 search_pid_scan:9.03 es_get:2.57 oplg get_record_by_pid:4.02 get_record_by_id:1.50 validate:0.59 reindex:83.43 search_pid_execute:6.16 search_pid_scan:10.32 es_get:2.45 ``` ## Observations On note des performances idéales un utilisant un file sytème en mémoire. Cependant ce type de file system n'est pas viable dans une instance de production. Globalement, les accès en lecture (DB+elasticsearch) sont similaire peu importe le type et le montage utilisé. Par contre, concernant le processus de réindexation, on remarque nettement une baisse considérable des performances probablement lié à l'ecriture sur disque. Les montages disque semble etre moint performant pour l'écriture de fichier
×
Sign in
Email
Password
Forgot password
or
By clicking below, you agree to our
terms of service
.
Sign in via Facebook
Sign in via Twitter
Sign in via GitHub
Sign in via Dropbox
Sign in with Wallet
Wallet (
)
Connect another wallet
New to HackMD?
Sign up