# 4Jayant Diana: ## PyTorch CPU only ### Activate Miniforge3 ```bash # Test on r1052 (irham, haswell architecture) source /sw/EasyBuild/haswell-rocky9/Miniforge3/24.9.0/bin/activate export CONDA_ENVS_PATH=/sw/EasyBuild/haswell-rocky9/Miniforge3/24.9.0/envs export CONDA_PKGS_DIRS=/sw/EasyBuild/haswell-rocky9/Miniforge3/24.9.0/pkgs ``` ```bash # PyTorch CPU version # https://pytorch.org export ENVNAME=/sw/EasyBuild/haswell-rocky9/Miniforge3/test-pytorch mamba create --no-default-packages --prefix $ENVNAME conda activate $ENVNAME conda install pytorch torchvision torchaudio cpuonly -c pytorch ```bash python3 -c "import torch; print(torch.__version__)" # 2.5.1 python3 -c "import torch; print(torch.cpu.is_available())" # True python3 -c "import torch; print(torch.cpu.device_count())" # 1 python3 -c "import torch; print(torch.cpu.current_device())" # cpu ``` ## bitsandbytes ### from source, some dependencies from PyPi ```bash module load gcc/12.3.0 module load python/3.12.7 module load cmake/3.26.3 module use /sw/EasyBuild/snowy-gpu/modules/all module load CUDA/12.6.0 git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git && cd bitsandbytes/ python3 -m venv dependencies-venv # Diana's addition source dependencies-venv/bin/activate # Diana's addition pip install --upgrade pip # Diana's addition pip install --upgrade setuptools # Diana's addition pip install --upgrade wheel # Diana's addition pip install -r requirements-dev.txt cmake -DCOMPUTE_BACKEND=cuda -S . make pip install -e . # `-e` for "editable" install, when developing BNB (otherwise leave that out) ```