ResNeXt

  • group convolution
  • element-wise summation

image.png

SENet

  • squeeze-and-excitation block

image.png

  • se-inception

image.png

  • se-resenet

image.png

SKNet

  • selective kernel convolution

image.png

  • more

    • split: different kernel size; group convolution to reduce computation
    • fuse: element-wise summation; SE block
    • select: multi-branch weighted sum

      ResNeSt

  • comparison: SENet | SKNet | ResNeSt block

image.png

  • split attention in caidinal groups

image.png

  • efficient radix-major implementation

image.png