ImageNet Classification with Deep Convolutional Neural Networks; AlexNet (2012)
AlexNet 1) 개요 - 60 million parameters and 650,000 neurons - Consists of 5 convolutional layers, some max-pooling layers, and 3 fully-connected layers. - Use softmax for the classification. - To make training faster, AlexNet used non-saturating neurons and a GPU. - Use dropout to reduce overfitting in the fully-connected layers. 2) ReLU activation function - LeNet-5 used Tanh function. - AlexNet ..