搞懂卷機網路 convolution network

概念

• 大致上就是透過filter去跟數值做點機後相加起來，成為新的數值
  https://www.youtube.com/watch?v=YRhxdVk_sIs&ab_channel=deeplizard
  

• link

• link
  

1d 2d 3d

https://stackoverflow.com/questions/42883547/intuitive-understanding-of-1d-2d-and-3d-convolutions-in-convolutional-neural-n

deep wise and point wise

Depthwise(DW)卷積與Pointwise(PW)卷積，合起來被稱作Depthwise Separable Convolution(參見Google的Xception)，該結構和常規卷積操作類似，可用來提取特徵，但相比於常規卷積操作，其參數量和運算成本較低。

• 正常版本
  

• deep wise + point wise
  

https://zhuanlan.zhihu.com/p/80041030

1*1 Convolution

https://hackerstreak.com/1x1-convolution/

把她想成 channel * 1 * 1就好
The MLP in the Network-in-Network (NIN) paper works by taking (1x1xC) slice as its input and produces an output value for each (1x1xC) slice of the input. So that means for an input tensor of shape (Height x Width x Channels), the NIN produces an output of shape (Height x Width).

所以1×1卷積其實就是作channel之間的合成

分組捲機

link

link

假設原本輸入 C_in * H * W
那麼Kernel size = C_out * Cin *H * W

if group Conv
那麼Kernel size = C_out * (C_in/g) *H * W