BatchNormalization論文閱讀與實作

參考:
論文
https://arxiv.org/pdf/1502.03167.pdf

Training Deep Neural Networks with Batch Normalization
https://zaffnet.github.io/batch-normalization

反向傳播Computational Graphs
Calculus on Computational Graphs: Backpropagation
https://colah.github.io/posts/2015-08-Backprop/

Neural Network Batch Normalization Fusion
https://leimao.github.io/blog/Neural-Network-Batch-Normalization-Fusion/

http://d2l.ai/chapter_convolutional-modern/batch-norm.html

FUSING CONVOLUTION AND BATCH NORM USING CUSTOM FUNCTION
https://pytorch.org/tutorials/intermediate/custom_function_conv_bn_tutorial.html

實作
https://github.com/renan-cunha/BatchNormalization