• batch size选择
• 归一化Normalization
• 正则化regularization
• 标准化Standardization (Z-score Normalization)
• 各种优化器
• Batch Normalization
• Weight Decay (Regularization)
• httpsblog.csdn.netqq_34886403articledetails85693888
• trick
• 李宏毅ML Lecture 9-1 Tips for Training DNN
• 知识蒸馏