# 2023-03 <br> HPC0: Introduction to Linux Welcome to the hack pad for HPC0 course from Research Computing at the University of Leeds! You can edit this document using [Markdown syntax](https://guides.github.com/features/mastering-markdown/). ## Contents 1. [Links to resource](#Links-to-resources) 2. [Further reading](#Further-reading) 3. [Agenda](#Agenda) 4. [Pre workshop prep](#Pre-workshop-prep) 4.1. [Windows Users](#For-Windows-Users) 4.2. [MacOS/Linux Users](#For-MacLinux-Users) 6. [What's your name and where do you come from?](#What’s-your-name-and-where-do-you-come-from) ## Links to resources - **Contact Research Computing** - https://bit.ly/arc-help - **Request HPC account** - https://leeds.service-now.com/it?id=sc_cat_item&sys_id=4c002dd70f235f00a82247ece1050ebc - **Slides for today** - https://arctraining.github.io/rc-slides/hpc0.html#/meta-code - **Exercises for today** - https://drive.google.com/file/d/1kBr8DLP0UAMH6gysKO7v1rQ-x1pcBQkb/view ## Further reading Linux crib sheet that covers lots of idea from today and beyond - https://drive.google.com/file/d/0B4hIpRJzq8DPVG5xdEJWcGlRTkU/view?usp=sharing ## Agenda | Time | Agenda | | -------- | ------------------------------- | | 0930 | Introduction, connecting to ARC | | 1020 | Break | | 1030 | Navigating the shell | | 1120 | Break and Exercise 1 | | 1130 | Data transformation in the shell| | 1220 | Wrap up and questions | | 1230 | Finish | ## Pre workshop prep ***If you haven’t already request an account for the HPC via this link - https://leeds.service-now.com/it?id=sc_cat_item&sys_id=4c002dd70f235f00a82247ece1050ebc*** For Windows users please consult our documentation page and video at https://arcdocs.leeds.ac.uk/getting_started/logon.html#connecting-from-windows You are required to download the software tool MobaXTerm for this workshop. ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba1.png) 1. Navigate using a web browser to https://mobaxterm.mobatek.net/ 2. Select Download ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba2.png) 3. Click Download Now for the Home Edition ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba3.png) 4. Select MobaXTerm Home Edition v21.0 (Portable edition) ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba4.png) 5. This opens a download prompt for a .zip file. Select Save File and click OK ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba5.png) 6. Go to your Download folder and find the .zip file you have just downloaded ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba6.png) 7. Click Extract in the Ribbon Bar and select Extract All ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba7.png) 8. Using the Wizard window extract the folder at the suggested location ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba8.png) 9. This should open the extracted folder immediately and allow you to double-click on the MobaXTerm_Personal_21.0 executable to start the application ![](https://raw.githubusercontent.com/ARCTraining/hackpad-templator/main/static/hpc0/moba9.png) **And you're all set for HPC0!🎉** ### For Mac/Linux Users: **MacOS and Linux users do not need MobaXTerm** but can use your builtin Terminal application. You should follow the steps outlined in the bitesize video titled [“Connecting to ARC off-campus via Linux/MacOS”](https://arc.leeds.ac.uk/help/videos/) and read carefully the [documentation section](https://arcdocs.leeds.ac.uk/getting_started/logon.html#connecting-from-linux-macos-systems) on connecting from Linux and MacOS, especially the section about configuring SSH for off-campus connections. Please attempt to read the documentation and watch the videos carefully and attempt the setup steps. If you have any problems don’t worry we will spend the start of the workshop making sure everyone is connected. In order to connect to ARC when you're off campus you'll need to do some extra configuration so that your SSH connection goes via our `remote-access` server. The following steps outline how to setup this configuration: 1. Open a Terminal on your Linux/macOS machine 2. Create a directory called `.ssh` in your home directory (if one doesn't already exist) ```bash $ mkdir ~/.ssh ``` 3. Then open a text editor of your choice and create a file called `config` in your `.ssh` directory ```bash # for instance use the simple nano text editor $ nano ~/.ssh/config ``` 4. Within this file include the following contents where `USERNAME` is replaced by your university username ```bash Host *.leeds.ac.uk !remote-access.leeds.ac.uk ProxyJump USERNAME@remote-access.leeds.ac.uk User USERNAME ``` 5. Save this file and your configuration is all set up! ## What's your name and where do you come from? - Kara-Louise Royle, PhD student from LICTR no experience with ARC. Experience with Statistical programming SAS, STATA, R. - Ollie Clark, Research Computing - Background in software engineering, databases and web development. Perl, Python C/C++ - John Hodrien, Research Computing, Computer Science graduate, who's used Linux, HPC and other tools since ~97. - Abi Shires, PhD Student in Medicine - bioinformatics, virology, and bacteriology - Amirul, PGR MEch Eng - Ankitha - PhD Marine Science - coral aquaculture - Jonathan - post-doc working on mapping wilderness, ecological connectivity and ecoacoustics. Need more parallel power for these huge datasets and want to stop asking John stupid questions ;-) - Grace, 1st year PhD student from FMH - Shamima Rahman - PhD student - Asma aladiyani, PhD student in chemistry - Chancey MacDonald, Marine Ecology, Post-doctoral researcher -some HPC - Linux basics from your website... to get going. - Edward Ellis, PhD Student in Medical AI, limited exposure to Linux - Oliver Mills, PhD Student in Medical AI. Brief exposure to Linux. - Andy Turner, Research Computing Team - Research Software Engineer, experienced with Unix/Linux, recently joined the team from the School of Geography after 25+ years specialising in computational geography - Esra Ugurlu, Economics Department, Lecturer, no prior knowledge of Linux - Eleanor Mitchell, Postdoc Biochemistry, a little bit of computer training but not used for research - Jonny Batty, Clinical PhD Student, Faculty of Medicine and Health. Applied cardiovascular epidemiology research. BSc in Computer Science - experience of Python, C++, Stata, R, but no HPC experience. - Arpita Saggar, PhD student, Background in Computer Science - Roshini , Postgraduate student - Owen Hibbert, Data Scientist at LIDA, Geography & Urban Data Background. - Sam Dobson Post doc in Virology, FBS - Javeria, Precision medicine MSc student from FBS, dentist by training, minimal knowledge of Linux, trying to learn some as I am doing my MSc project on UKBiobank data