---
# System prepended metadata

title: Hadoop practice note 1-1
tags: [DE, Hadoop]

---

# Hadoop practice note 1-1
* Win7
* VirtualBox 6.1.0
* HDP 2.5

## :memo: Where do I start?

### Step 1: Download HDP ova

* [VirtualBox - HDP 2.5](https://archive.cloudera.com/hwx-sandbox/hdp/hdp-2.5.0/HDP_2.5_virtualbox.ova)
* [VirtualBox - HDP 2.6.5](https://archive.cloudera.com/hwx-sandbox/hdp/hdp-2.6.5/HDP_2.6.5_virtualbox_180626.ova)
* [VirtualBox_Extension_Pack-6.1.0](https://www.virtualbox.org/wiki/Downloads)


### Step 2: Import application to virtualBox
![](https://i.imgur.com/sBcXXH8.png)

### Step 3: 啟動VM
![](https://i.imgur.com/7rI7qEn.png)

### Step 4: 啟動HDP
* 開起網頁: http://127.0.0.1:8888
* 帳號: maria_dev/ maria_dev
* Admin: admin/ hadoop
![](https://i.imgur.com/zLQsEuO.png)
![](https://i.imgur.com/TNAnznh.png)

### step 5: 上傳Data
* 利用Hive上傳u.data和u.item，並命名為ratings和movie_id。
![](https://i.imgur.com/nRvr0NL.png)

* 檢查上傳是否成功
* 裡用SQL下指令
	``` SQL=
	SELECT movie_id, count(movie_id) as ratingCount
	FROM ratings
	GROUP BY movie_id
	ORDER BY ratingCount
	DESC;
	```
	![](https://i.imgur.com/5dqBjwg.png)
* 使用vitualization
![](https://i.imgur.com/KOmdoqw.png)



## :interrobang: Error msg
1. 啟動VM時的錯誤訊息
	* 內容：Unable to allocate and lock memory. The virtual machine will be paused. Please close applications to free up memory or close the VM.
錯誤 ID：HostMemoryLow
嚴重性：非致命錯誤
	* 解決方式：升級virtualBox到6.1.0

2. 使用vitualization出現以下訊息畫面
	![](https://i.imgur.com/XiEoxJv.png)
	* 解決方式：SQL重新run一變。


###### tags: `DE`,`Hadoop`