--- tags: computer science, raspberry --- # How To Build A Computer Cluster by Raspberry Pi 4Bs Author: Zheng-Liang Lu (Arthur) Time: ~~2020-09-22 ~ present~~ 2021-10-12 ~ present ![](https://i.imgur.com/oc5IuJ3.png =200x) ## ++Hardwares++ ### Raspberry Pi 4 Model B - Board: https://www.raspberrypi.com.tw/28040/raspberry-pi-4-model-b/ ![](https://i.imgur.com/24KM5kX.png =500x) - https://goods.pchomeus.com/item/show?30202451040494 ![](https://i.imgur.com/eFJ79Zc.png =200x) ## ++Softwares++ ### Operating Systems - Ubuntu for RP4b: https://ubuntu.com/download/raspberry-pi - References - [Raspberry Pi OS](https://www.raspberrypi.com/software/) - [Raspberry Pi 的基礎 - 40 套作業系統任你選之 2017 威力加強版](http://blog.itist.tw/2016/12/34-best-operating-systems-for-raspberry-pi.html) - [Linux Commodity Clusters Overview](https://computing.llnl.gov/tutorials/linux_clusters/) ### Performance Benchmarks - https://www.itread01.com/content/1549618756.html - CPU: - http://www.roylongbottom.org.uk/Raspberry%20Pi%20Benchmarks.htm - https://www.howtoforge.com/tutorial/hpl-high-performance-linpack-benchmark-raspberry-pi/ - https://wiki.archlinux.org/index.php/Stress_testing - https://socialcompare.com/en/comparison/raspberrypi-models-comparison - Disk - https://linuxconfig.org/how-to-benchmark-disk-performance-on-linux - https://www.akitio.com/information-center/achieve-best-transfer-speeds-external-drives - https://magpi.raspberrypi.org/articles/raspberry-pi-4-specs-benchmarks ```bash= time dd if=/dev/zero of=~/sf_R_DRIVE/tmp.out bs=1G count=1 oflag=dsync ``` - Ramdisk - https://magiclen.org/linux-ramdisk/ - https://www.itread01.com/content/1547865917.html - https://linuxconfig.org/how-to-monitor-ram-usage-on-linux - Cluster monitoring ## ++Applications++ ### Financial Crawler - Taiwan markets: stocks, options and futures, foreign exchanges, chips? ### Distributed Computing - Computation-intensive problems: - Monte Carlo simulation - https://downloads.ti.com/mctools/esd/docs/opencl/examples/monte_carlo.html - https://digitalcommons.mtech.edu/cgi/viewcontent.cgi?article=1198&context=grad_rsch - Ising Model - http://www.physik.uni-leipzig.de/~bruenecke/Report.pdf - Primes - https://magpi.raspberrypi.org/articles/build-a-raspberry-pi-cluster-computer - References: https://archive.fosdem.org/2020/schedule/event/rpi_cluster/attachments/slides/3635/export/events/attachments/rpi_cluster/slides/3635/Introducing_HPC_with_a_Raspberry_Pi_Cluster.pdf - http://www.physik.uni-leipzig.de/~bruenecke/Report.pdf - https://github.com/mskr/clustermcml - Spark - https://spark.apache.org/ - Hadoop - https://hadoop.apache.org/ - http://tw.gitbook.net/hadoop/index.html - https://medium.com/analytics-vidhya/build-raspberry-pi-hadoop-spark-cluster-from-scratch-c2fa056138e0 - Holden Karau, Andy Konwinski, Patrick Wendell, [Learning Spark](https://www.oreilly.com/library/view/learning-spark/9781449359034/), 2015 - Sample code: https://github.com/databricks/learning-spark - Foundation of Linux Kernel - https://www.facebook.com/groups/system.software2020 - https://ccckmit.gitbooks.io/lowlevelc/content/ - https://www.spreered.com/compiler_for_dummies/?fbclid=IwAR18HW2LvKNG-zD0WReqb6PX2jrPOZ2yxqM6f0M_SA_rGw3t_bCNEJQ91TQ - https://codertw.com/%E7%A8%8B%E5%BC%8F%E8%AA%9E%E8%A8%80/648114/ ### Trading Simulation - 模擬交易所之搓合、買賣家掛單 ### Network Attached Storage (NAS) & Home Media Center - https://magpi.raspberrypi.org/articles/build-a-raspberry-pi-nas - RAID: https://www.youtube.com/watch?v=Y_l1BCCqZSQ - SSD? https://24h.pchome.com.tw/prod/DRAH5U-A90084OHG - https://www.youtube.com/watch?v=bpvlEbdA6qI&t=187s - How to build a Raspberry Pi 4 NAS Server? - Samba and OMV: https://www.seeedstudio.com/blog/2019/12/24/how-to-build-a-raspberry-pi-4-nas-server-samba-and-omv/ - https://www.youtube.com/watch?v=2Lb2cNOi3tM ### Object Detection Using tensorflow - https://youtu.be/Vg9rrOFmwHo ### Blockchains - https://www.rs-online.com/designspark/exploring-ethereum-with-raspberry-pi-part-1-getting-started ### Old-School Game Center - https://retropie.org.uk/ ## Command Notes - Screenshot - https://help.ubuntu.com/stable/ubuntu-help/screen-shot-record.html - How to change the hostname? https://linuxize.com/post/how-to-change-hostname-on-debian-9/ ```bash hostnamectl ``` - https://fio.readthedocs.io/en/latest/fio_doc.html