# Ollama安裝教學

## :memo: Where do I start?
- 聯絡窗口 Email us : [e-mail] 王小姐

## 安裝 Docker
請參考 https://hackmd.io/@whYPD8MBSHWRZV6y-ymFwQ/rynv0a7CT

## Ollam 範例GPU測試
### 下載並部屬Ollama (依照您的硬體三選一)

http://host.docker.internal:11434

1. CPU eample: Start the container
--cpuset-cpus=1

mkdir $HOME/ollama
docker run -d -v $HOME/ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

2. NVIDIA GPU eample: Start the container

mkdir $HOME/ollama
docker run -d --gpus=all -v $HOME/ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama


mkdir $HOME/ollama
docker run -d --gpus=all -v $HOME/ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama:0.1.32

3. AMD GPU eample: Start the container
To run Ollama using Docker with AMD GPUs, use the rocm tag and the following command:

mkdir $HOME/ollama
docker run -d --device /dev/kfd --device /dev/dri -v $HOME/ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama:rocm

### 下載 model from Ollama website
- Download model:

#docker exec -it ollama ollama pull llama2
docker exec -it ollama ollama pull gemma
docker exec -it ollama ollama pull ycchen/breeze-7b-instruct-v1_0
docker exec -it ollama ollama pull yabi/breeze-7b-instruct-v1_0_q8_0
docker exec -it ollama ollama pull nomic-embed-text

- local model:

docker exec -it ollama bash 
mkdir -p /root/.ollama/download
cd /root/.ollama/download
wget https://huggingface.co/ZoneTwelve/TAIDE-LX-7B-Chat-GGUF/resolve/main/TAIDE-LX-7B-Chat.Q8_0.gguf
echo "FROM /root/.ollama/download/TAIDE-LX-7B-Chat.Q8_0.gguf" > /root/.ollama/download/Modelfile_demo
ollama create TAIDE-LX-7B-Chat -f /root/.ollama/download/Modelfile_demo

- List download model:

docker exec -it ollama ollama list

- Remove model

#docker exec -it ollama ollama rm llama2

- api ("stream": false  or  "stream": true  )

curl http://localhost:11434/api/generate -d '{
"model": "ycchen/breeze-7b-instruct-v1_0",
"prompt": "請列出五樣台灣美食",
"stream": true,
"options": {
"seed": 123,
"top_k": 20,
"top_p": 0.9,
"temperature": 0
}
}'

### 輸出結果
![image](https://hackmd.io/_uploads/rJW39bE0p.png)

### 部分字變成詞
![image](https://hackmd.io/_uploads/HkSMBzBCa.png)

### :a: 影片教學
{%youtube FPJo3oAg15w %}