owned this note changed 7 years ago
Linked with GitHub

uTensor: AI on Microcontroller - Neil Tan, Kazami Hsieh and Dboy Liao

歡迎來到 https://hackmd.io/c/COSCUP2018 共筆

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →

點擊本頁上方的 開始用 Markdown 一起寫筆記!
手機版請點選上方 按鈕展開議程列表。

Complete Slides

uTensor

  • Deep Learning x Microcontroller
    • ML lib
    • Inference
    • System Integration
  • Embedded 日常
    • C/C++ porting
    • Flash device
    • RT behavior
    • Code size
  • Workflow
    • Collect: data
    • -> train: graph (tensorflow)
    • -> gen: C++ (uTensor)
    • -> compile: binary (arm mbed)
    • -> flash: run
  • Graph
    • Microcontroller RAM 上限約 1~2M
    • SDTensor or RomTensor
      • weight flashed in rom
      • execute without SD card
      • SD Tensor for infinite mem
      • SDT: 在SD卡上存weight,RAM只做cache
      • RT: 把 weighting 全部 flash 在 rom 上
        • flash vs ram 速度差別不大
  • Execution
    • 轉換成圖做計算
    • reference counting -> compile time 就決定

utensor_cgen

  • Automatic Code Generator
  • Tensorflow vs uTensor
    • tf.Graph() -> Context
    • tf.Tensor -> Tensor/SDTensor/RomTensor/RamTensor
    • tf.Operation -> Operator
  • utensor-cgen
    • pb file to uTensor cpp
    • utensor-cli simple_mnist.pb --output-node=y_pred
  • slides for the code generation part presented by DBoy Liao

See Also

tags: COSCUP2018 data
Select a repo