# Parallel Programming
###### tags: `SS2021-IN2147-PP`
> Martin Schulz

<!-- ### TUM ROCKET.CHAT
* [CHAT.TUM.DE](https://chat.tum.de/channel/parprog21) -->

## Menu & Progress
* [x] [0 My Preview](/j40B8JymRv2L4ZU_pktUJA)
* [x] [1 Introduction](/vqxWGaXqRfGAzidJ-gSZVg)
* [x] [2 Pthreads Programming](/Bq1_sZMVQSWx_tupQbw0UQ)
* [x] [3 Introduction into OpenMP 5.0](/AeNIa1tfTLSQx4ChtWKtCQ)
* [x] [4 Advanced OpenMP and Changes since OpenMP 5.0](/hft3Yu7NSnOopnrceqOSEg)
* [x] [5 SIMD](/ofFrHpVwT3StId_PrBHg8A)
* [x] [6 Shared Memory Performance Issues](/LwNVpSNCS36GvH6mW8oq5A)
* [x] [7 Introduction into HPC Systems and Applications](/1knsauddTd-GDGEWGrW0Bg)
* [x] [8 Introduction into MPI](/fJsI3w_NQVyOUT9Tm0MfZw)
* [x] [9 Advanced MPI Communication Techniques Part 1](/ZGMg9RlMTS2jPtW_0mntQA)
* [x] [10 Advanced MPI Communication Techniques Part 2](/ZxmkeyhtSv-RDedPVBXIAg)
* [x] [11 Scaling - Challenges and Techniques](/k5KWgnjUTZeOWkIBr7Pt0Q)
* [x] [12 Accelerators and GPU Programming with CUDA](/pbKxPyixQ1KRyQkGkbSPWA)

<!-- ## Exercise
* [caps.in.tum / teaching / parprog / SS2021 / Published Assignments · GitLab](https://gitlab.lrz.de/lrr-tum/teaching/parprog/ss2021/published-assignments)
* [Mafidyuz/parallel_programming](https://github.com/Mafidyuz/parallel_programming) -->

## Fianl Project
* [Parprog Final Project - GE](/JclEN-95TQyxkmRsnu4LYQ)

## Recommended Reading
* [Intel® Intrinsics Guide](https://software.intel.com/sites/landingpage/IntrinsicsGuide/#techs=AVX&expand=4980,3333,3931,2947,5590&text=store_ps)
* [Introduction to Parallel Computing Tutorial | High Performance Computing](https://hpc.llnl.gov/training/tutorials/introduction-parallel-computing-tutorial)
* [【平行運算】CUDA教學(一) 概念介紹 - 都會阿嬤](https://weikaiwei.com/parallel-computing/cuda-part1/)
* [使用 perf_events 分析程式效能 | 羅根學習筆記](https://zh-blog.logan.tw/2019/07/10/analyze-program-performance-with-perf-events/)
* [簡介 perf_events 與 Call Graph | 羅根學習筆記](https://zh-blog.logan.tw/2019/10/06/intro-to-perf-events-and-call-graph/)
* [MPI并行计算学习笔记6——行主元高斯消去法_askjff的博客-CSDN博客](https://blog.csdn.net/askjff/article/details/106088330)

## 筆記撰寫規則
* 冒號使用全形冒號「：」。
* 中英混用時，英文字母前後半形空白。
* 你好 Hello 我是王曉明。
* 括弧使用半形括弧「()」，與中文英文混用時，前後均加半形空白。
* 你好 (Hello) 我是王曉明。
* 如英文字母或半形括弧遇到全形標點符號時，不需添加半形空白。
* 你好，(Hello) 我是王曉明。