# Jetson Xavier NX ###### tags: `Jetson Xavier NX` ## Nvidia jetpack 5.0以上版本特性 ### NVIDIA jetpack docker image * TensorRT Nvinfer需使用到host端資源** * libnvmedia_tensor.so => not found * libnvmedia_dla.so => not found * 官方目前只提供jetpack 5.0以上版本image [[link]](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/l4t-jetpack) * 若要使用舊版建構l4t-base [[link]](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/l4t-base),需取得arm架構(cuda cudnn tensorrt) deb file * 在舊有架構中(jetpack 5.0以下),有機會拿到Nvidia不小心流出的arm64 deb檔,可直接原地升級(cuda cudnn tnesorrt),現有官網只提供ubuntu 20.04(jetpack 5.0以上板本) ### Jetson XavierNX * 刷機教學 * [system is built on sd card](https://blog.csdn.net/zbb297918657/article/details/106390209) * [system is built on emmc](https://blog.csdn.net/wjinjie/article/details/118295766) * 需自備 jumper短路xavier 2個ping腳位, 進入recovery mode * 安裝NVIDIA sdkmanger * 系統轉移(emmc or sd card容量不足) * Jetson Xavier NX上以SSD運行作業系統[[link]](https://blog.cavedu.com/2020/06/02/jetson-xavier-nx-ssd/) * minicom -D /dev/ttyACM0 -8 -b 115200 ## **peformance** <table dir="ltr" border="1" cellspacing="0" cellpadding="0"><colgroup><col width="100" /><col width="155" /><col width="156" /><col width="100" /><col width="156" /><col width="133" /></colgroup> <tbody> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;dataset num&quot;}">dataset num</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:3670}">3670</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;GPU&quot;}">GPU</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;RTX 2080 TI&quot;}">RTX 2080 TI</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;backbone&quot;}">backbone</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;resolution&quot;}">resolution</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot; precision&quot;}">precision</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;mAP&quot;}">mAP</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;FPS&quot;}">FPS</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;inference(ms)&quot;}">inference(ms)</td> </tr> <tr> <td style="text-align: center;" colspan="1" rowspan="9" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;yolox-m&quot;}"> <div>yolox-m</div> </td> <td style="text-align: center;" colspan="1" rowspan="3" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;640x640&quot;}"> <div>640x640</div> </td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;fp32&quot;}">fp32</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:77.04}">77.04</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:110}">110</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:9.09}" data-sheets-formula="=ROUND(1*1000/R[0]C[-1],2)">9.09</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;fp16&quot;}">fp16</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:77.07}">77.07</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:240}">240</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:4.17}" data-sheets-formula="=ROUND(1*1000/R[0]C[-1],2)">4.17</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;int8&quot;}">int8</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:70.03}">70.03</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:312}">312</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:3.21}" data-sheets-formula="=ROUND(1*1000/R[0]C[-1],2)">3.21</td> </tr> <tr> <td style="text-align: center;" colspan="1" rowspan="3" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;416x416&quot;}"> <div>416x416</div> </td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;fp32&quot;}">fp32</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;fp16&quot;}">fp16</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:71.86}">71.86</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:390}">390</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:2.56}" data-sheets-formula="=ROUND(1*1000/R[0]C[-1],2)">2.56</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;int8&quot;}">int8</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> </tr> <tr> <td style="text-align: center;" colspan="1" rowspan="3" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;640x416&quot;}"> <div>640x416</div> </td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;fp32&quot;}">fp32</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;fp16&quot;}">fp16</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:77.07}">77.07</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:283}">283</td> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:3.53}" data-sheets-formula="=ROUND(1*1000/R[0]C[-1],2)">3.53</td> </tr> <tr> <td style="text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;int8&quot;}">int8</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> <td style="text-align: center;">&nbsp;</td> </tr> </tbody> </table> ## **flow** ![](https://drive.google.com/uc?export=view&id=1hBbPXu0ES-leel1hwiuQNopPTc5BmgCC) ## **pre precessing latency** <table dir="ltr" border="1" cellspacing="0" cellpadding="0"><colgroup><col width="100" /><col width="100" /><col width="131" /><col width="141" /><col width="128" /></colgroup> <tbody> <tr> <td style="width: 100px; text-align: center;">&nbsp;</td> <td style="width: 100px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Device&quot;}">Device</td> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Image Resolution&quot;}">Image Resolution</td> <td style="width: 160px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Model Resolution&quot;}">Model Resolution</td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Prepare Input (ms)&quot;}">Prepare Input (ms)</td> </tr> <tr> <td style="width: 100px; text-align: center;" colspan="1" rowspan="6" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;XavierNX&quot;}"> <div>XavierNX</div> </td> <td style="width: 100px; text-align: center;" colspan="1" rowspan="3" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;CPU&quot;}"> <div>CPU</div> </td> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;3840 x 2160&quot;}">3840 x 2160</td> <td style="width: 160px; text-align: center;" colspan="1" rowspan="6" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;640x640&quot;}"> <div>640x640</div> </td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:6.372}">6.372</td> </tr> <tr> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;1920 x 1080&quot;}">1920 x 1080</td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:5.963}">5.963</td> </tr> <tr> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;1280 x 720&quot;}">1280 x 720</td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:5.425}">5.425</td> </tr> <tr> <td style="width: 100px; text-align: center;" colspan="1" rowspan="3" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;GPU&quot;}"> <div>GPU</div> </td> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;3840 x 2160&quot;}">3840 x 2160</td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:3.155}">3.155</td> </tr> <tr> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;1920 x 1080&quot;}">1920 x 1080</td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:1.055}">1.055</td> </tr> <tr> <td style="width: 176px; text-align: center;" data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;1280 x 720&quot;}">1280 x 720</td> <td style="width: 126px; text-align: center;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:0.659}">0.659</td> </tr> </tbody> </table>