超電筆記 - HackMD

###### tags: `isc2020` # 超電筆記 ## 系統初始更新 ```shell= sudo apt update && apt upgrade -y ``` ```shell= sudo apt install gfortran vim -y ``` ## 安裝openmpi #### 1.下載及解壓縮 ```shell= cd wget https://download.open-mpi.org/release/open-mpi/v4.0/openmpi-4.0.1.tar.gz tar xvf openmpi-4.0.1.tar.gz cd openmpi-4.0.1 ``` #### 2.編譯 ```shell= ./configure --prefix=$HOME/openmpi make make install ``` #### 3.修改terminal環境變數初始值 ```shell= vim ~/.bashrc ``` 加入以下內容在檔案最底 ```shell= #openmpi export PATH=$PATH:$HOME/openmpi/bin export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$HOME/openmpi/lib ``` ```shell= source ~/.bashrc ``` #### 4.測試安裝結果 ```shell= mpirun --version ``` ## 安裝HPL (法一) #### 1.下載及解壓縮 ```shell= cd wget https://netlib.org/benchmark/hpl/hpl-2.3.tar.gz tar xvf hpl-2.3.tar.gz cd hpl-2.3 cp setup/Make.Linux_ATHLON_CBLAS . ``` #### 2.安裝atlas ```shell= sudo apt install libatlas3-base -y ``` #### 3.修改Makefile內的程式路徑 ```shell= vim Make.Linux_ATHLON_CBLAS ``` 修改後的路徑(ubuntu 16.04) ```shell= TOPdir = $(HOME)/hpl-2.3 MPdir = $(HOME)/openmpi MPlib = $(MPdir)/lib/libmpi.so LAdir = /usr/lib/atlas-base LAlib = $(LAdir)/libcblas.so.3 $(LAdir)/libatlas.so.3 ``` 修改後的路徑(ubuntu 18.04) ```shell= TOPdir = $(HOME)/hpl-2.3 MPdir = $(HOME)/openmpi MPlib = $(MPdir)/lib/libmpi.so LAdir = /usr/lib/x86_64-linux-gnu LAlib = $(LAdir)/libcblas.so.3 $(LAdir)/libatlas.so.3 ``` #### 4.編譯 ```shell= make arch=Linux_ATHLON_CBLAS ``` #### 5.修改HPL.dat ```shell= cd bin/Linux_ATHLON_CBLAS vim HPL.dat ``` 修改以下項目 ```shell= 1 # of process grids (P x Q) 1 Ps 核心數量 Qs ``` #### 6.執行 ```shell= mpirun -np 核心數量 ./xhpl ``` ## 安裝HPL (法二) #### 1.下載及解壓縮 ```shell= cd wget https://netlib.org/benchmark/hpl/hpl-2.3.tar.gz tar xvf hpl-2.3.tar.gz cd hpl-2.3 cp setup/Make.Linux_PII_FBLAS . ``` #### 2.安裝blas ```shell= cd wget http://www.netlib.org/blas/blas-3.8.0.tgz tar xzvf blas-3.8.0.tgz cd BLAS-3.8.0 make ``` #### 3.修改Makefile內的程式路徑 ```shell= cd cd hpl-2.3 vim Make.Linux_PII_FBLAS ``` 以下為修改後的路徑 ```shell= TOPdir = $(HOME)/hpl-2.3 MPdir = $(HOME)/openmpi MPlib = $(MPdir)/lib/libmpi.so LAdir = $(HOME)/BLAS-3.8.0 LAlib = $(LAdir)/blas_LINUX.a CC = mpicc LINKER = mpif77 ``` #### 4.編譯 ```shell= make arch=Linux_PII_FBLAS ``` #### 5.修改HPL.dat ```shell= cd bin/Linux_PII_FBLAS vim HPL.dat ``` 修改以下項目 ```shell= 1 # of process grids (P x Q) 1 Ps 核心數量 Qs ``` #### 6.執行 ```shell= mpirun -np 核心數量 ./xhpl ``` ## 安裝linpack ```shell= cd wget https://software.intel.com/sites/default/files/managed/e4/1c/l_mklb_p_2019.5.004.tgz tar xvf l_mklb_p_2019.5.004.tgz cd l_mklb_p_2019.5.004/benchmarks_2019/linux/mkl/benchmarks/linpack ./runme_xeon64 ``` 參考輸出 ```shell= Sample data file lininput_xeon64. Current date/time: Wed Sep 25 02:34:17 2019 CPU frequency: 4.941 GHz Number of CPUs: 1 Number of cores: 6 Number of threads: 6 Parameters are set to: Number of tests: 15 Number of equations to solve (problem size) : 1000 2000 5000 10000 15000 18000 20000 22000 25000 26000 27000 30000 35000 40000 45000 Leading dimension of array : 1000 2000 5008 10000 15000 18008 20016 22008 25000 26000 27000 30000 35000 40000 45000 Number of trials to run : 4 2 2 2 2 2 2 2 2 2 1 1 1 1 1 Data alignment value (in Kbytes) : 4 4 4 4 4 4 4 4 4 4 4 1 1 1 1 Maximum memory requested that can be used=16200901024, at the size=45000 =================== Timing linear equation system solver =================== Size LDA Align. Time(s) GFlops Residual Residual(norm) Check 1000 1000 4 0.003 192.0187 9.834356e-13 3.353768e-02 pass 1000 1000 4 0.003 249.1399 9.834356e-13 3.353768e-02 pass 1000 1000 4 0.003 227.7630 9.834356e-13 3.353768e-02 pass 1000 1000 4 0.003 243.8787 9.834356e-13 3.353768e-02 pass 2000 2000 4 0.024 225.1438 4.213629e-12 3.665341e-02 pass 2000 2000 4 0.024 224.5616 4.213629e-12 3.665341e-02 pass 5000 5008 4 0.283 294.8352 2.206207e-11 3.076378e-02 pass 5000 5008 4 0.316 263.8440 2.206207e-11 3.076378e-02 pass 10000 10000 4 2.213 301.2795 9.111056e-11 3.212651e-02 pass 10000 10000 4 2.235 298.4383 9.111056e-11 3.212651e-02 pass 15000 15000 4 7.353 306.0653 2.326349e-10 3.664038e-02 pass 15000 15000 4 7.716 291.6761 2.326349e-10 3.664038e-02 pass 18000 18008 4 12.721 305.6926 3.236211e-10 3.544049e-02 pass 18000 18008 4 13.031 298.4047 3.236211e-10 3.544049e-02 pass 20000 20016 4 17.725 300.9408 3.888804e-10 3.442444e-02 pass 20000 20016 4 17.155 310.9437 3.888804e-10 3.442444e-02 pass 22000 22008 4 23.648 300.2228 5.338488e-10 3.910232e-02 pass 22000 22008 4 23.454 302.7076 5.338488e-10 3.910232e-02 pass 25000 25000 4 34.238 304.2814 5.845216e-10 3.323965e-02 pass 25000 25000 4 34.359 303.2078 5.845216e-10 3.323965e-02 pass 26000 26000 4 39.697 295.2054 6.949106e-10 3.654048e-02 pass 26000 26000 4 38.448 304.7970 6.949106e-10 3.654048e-02 pass 27000 27000 4 43.029 304.9906 6.305595e-10 3.074928e-02 pass 30000 30000 1 58.679 306.7854 8.527306e-10 3.361473e-02 pass 35000 35000 1 94.577 302.2485 1.258474e-09 3.653158e-02 pass 40000 40000 1 139.402 306.0931 1.578189e-09 3.509946e-02 pass 45000 45000 1 204.315 297.3543 1.655906e-09 2.913393e-02 pass Performance Summary (GFlops) Size LDA Align. Average Maximal 1000 1000 4 228.2001 249.1399 2000 2000 4 224.8527 225.1438 5000 5008 4 279.3396 294.8352 10000 10000 4 299.8589 301.2795 15000 15000 4 298.8707 306.0653 18000 18008 4 302.0487 305.6926 20000 20016 4 305.9423 310.9437 22000 22008 4 301.4652 302.7076 25000 25000 4 303.7446 304.2814 26000 26000 4 300.0012 304.7970 27000 27000 4 304.9906 304.9906 30000 30000 1 306.7854 306.7854 35000 35000 1 302.2485 302.2485 40000 40000 1 306.0931 306.0931 45000 45000 1 297.3543 297.3543 Residual checks PASSED End of tests 2019/09/25 週三上午 02:54 ``` ## 安裝HPCG #### 1.安裝git ```shell= sudo apt install git -y ``` #### 2.下載HPCG及編譯 ```shell= cd git clone https://github.com/hpcg-benchmark/hpcg.git cd hpcg mkdir build cd build ../configure Linux_MPI make cd bin vim hpcg.dat ``` 修改數字 ```shell= 24 24 24 60 ``` #### 3.執行 ```shell= mpirun -np 核心數量 ./xhpcg ``` ## 安裝HPCC #### 1.下載 ```shell= cd wget http://icl.cs.utk.edu/projectsfiles/hpcc/download/hpcc-1.5.0.tar.gz tar -xvf hpcc-1.5.0.tar.gz cd hpcc-1.5.0 cp hpl/setup/Make.Linux_ATHLON_CBLAS hpl/Make.Linux vim hpl/Make.Linux ``` 更改以下行列 ```shell= TOPdir = $(HOME)/hpcc-1.5.0/hpl MPdir = /home/ncku/openmpi3 LAdir = /usr/lib/atlas-base LAlib = $(LAdir)/libcblas.so.3 $(LAdir)/libatlas.so.3 CCFLAGS = $(HPL_DEFS) -fomit-frame-pointer -O3 -funroll-loops -W -Wall -std=c99 ``` #### 察看結果 ```shell= ./hpccoutf.pl -wf hpccoutf.txt ``` ## 安裝tensorflow ```shell= sudo apt install python3-pip -y pip3 install tensorflow==1.13.2 git clone https://github.com/tensorflow/models.git cd models git checkout r1.13.0 cd tutorials/image/cifar10 python3 cifar10_train.py ```