--- tags: Intel, Profile, MPI --- # Intel Trace Analyzer and Collector Usage ## What is ITAC ITAC (included in OneAPI) is a MPI tracer and analyer for intelmpi, if your program can be compiled with Intel MPI, then you can get a detailed MPI trace data by ITAC. ![a itac result](https://docs.nersc.gov/tools/performance/itac/itac-event-timeline.png) ## How to use ITAC ### setup for tracing ``` bash module use /scinet/intel/oneapi/2021u4/itac/latest/modulefiles module load itac export LD_PRELOAD=/scinet/intel/oneapi/2021u4/itac/latest/slib/libVT.so ``` ### config tracer #### by Env ``` bash export VT_LOGFILE_FORMAT=stfsingle export VT_PCTRACE=5 export VT_LOGFILE_NAME=... ``` #### by Config File ``` bash export VT_CONFIG=/home/l/lcl_uotiscscc/lcl_uotiscsccs1034/icon/hand/icon-intelmpi/build/experiments/exp_scc2850/scripts/itac.conf ``` #### Config Options Just list some useful: ``` bash # This line will be ignored as a comment CURRENT-DIR "/home/l/lcl_uotiscscc/lcl_uotiscsccs1034/icon/hand/icon-intelmpi/build/experiments/exp_scc2850/scripts" # The Intel Trace Collector uses the current working directory of the process that reads the configuration on all processes to resolve relative path names. You can override the current working directory with this option. PCTRACE 5 # trace level normally use 5 PCTRACE-FAST on # trace without check fails MEM-MAXBLOCKS 16 # trace max block on memory PROCESS 0:N OFF # turn off trace for all core PROCESS 1:N:10 on # turn on trace for core #1,11,..10n+1 tile N # by turning off trace for some cores can reduce the Memory usage and accelerate the trace speed. TIME-WINDOWS 0:1, 420:720 # open trace for some time: from sec 0 to sec 1 and sec 420 to sec 720. ``` for more options you can find in [IntelĀ® Trace Collector User and Reference Guide](https://www.intel.com/content/dam/develop/public/us/en/documents/intel-trace-collector-2019u3-user-and-reference-guide.pdf) ### issues #### oom turn down the `MEM-MAXBLOCKS` and use less process to trace. ## visualize ITAC result ``` bash traceanalyzer /path/to/collection/database/foo.stf ```