---
# System prepended metadata

title: Data Processing/Analysis

---

# Data Processing/Analysis
Our team working github
> https://github.com/chihyangchen/ntu-experiments

## pcap file

### **wireshark**
Directly use wireshark gui. 
> Download:
> https://www.wireshark.org/download.html

### **tshark**
It can change pcap file to csv file in convenience of data processing.

1. Run the python code pcap_to_csv.py to the directory of your data. The code is at 
> code:
> https://github.com/chihyangchen/ntu-experiments/tree/Sheng-Ru/sheng-ru/post_processing.
```
python3 pcap_to_csv.py dir/to/your/pcap/data
```
> ex:
```
python3 pcap_to_csv.py ../old_pcap/5min.pcap
```
2. Analysis example - TCP RTT
Try simple_plot.ipynb at
> https://github.com/chihyangchen/ntu-experiments/tree/Sheng-Ru/sheng-ru/analysis.

## mi2log file

1. Open MobileInsight app during experiment.
2. Get the log recorded in phone memory. It will be at <font color=red>sdcard/mobileinsight/log</font>.
* use adb pull or USB to get the file from the phone

4. Data Analyzing:
    3A. Directly use mobileinsight gui.
    
    Enter the command below and open your mi2log file.
    
    `mi-gui`
    
    3B. Convert mi2log to csv data.
    - mi2log -> txt
    
    `python3 offline_analysis.py dir/to/your/mi2log/file`
    
    - txt -> csv

    `python3 xml_mi.py dir/to/your/mi2log/to/txt/file`
    
* All the code of data post processed are at 
> https://github.com/chihyangchen/ntu-experiments/tree/Sheng-Ru/sheng-ru/post_processing.     

4. Analysis example
    * Handover event -> policy_tracked.ipynb
    * signal strength -> unstable_ho_observer.ipynb
    
* All the code of data analysis are at 
> https://github.com/chihyangchen/ntu-experiments/tree/Sheng-Ru/sheng-ru/post_processing.
## Learn

1. Paper reading

> https://drive.google.com/drive/u/0/folders/1fPtbc6HVvn1nE29FH73yac5Yd8cRjCGA

2. IEEE Xplore
> https://ieeexplore.ieee.org/Xplore/home.jsp

3. ACM 
> https://dl.acm.org/

4. Sharetechnote
> https://www.sharetechnote.com/