---
# System prepended metadata

title: Merge + Eval

---

# Merge
```bash=
!git clone https://github.com/cg123/mergekit.git
%cd mergekit
!pip install -e .
!mergekit-yaml config/config_v1.yaml models/supermerge --cuda
```

# Eval
```bash=
!git clone https://github.com/EleutherAI/lm-evaluation-harness.git
%cd lm-evaluation-harness
!git checkout b281b09
!pip install -e .
```

```bash=
!python main.py --model=hf-causal-experimental --model_args="pretrained=janhq/supermario-slerp-v3,use_accelerate=True" --tasks=gsm8k --num_fewshot=5 --batch_size=8 --output_path=result/
```