基于蒙特卡洛Dropout的深度学习不确定度探究

    Exploration of Deep Learning Uncertainty Based on Monte Carlo Dropout

    • 摘要: 随着人工智能的快速发展,深度学习技术已广泛应用于医疗诊断、自动驾驶等领域。但深度学习模型固有的“黑箱”特性与结构复杂性,使得其不确定度既无法依据物理原理直接推导,也难以通过明确的函数公式进行显式表达,进而制约模型在高可靠场景落地的关键瓶颈。蒙特卡洛Dropout作为当前评估深度学习模型不确定度的常用方法,以此为核心工具设计实验探究不同Dropout率对模型不确定度及性能的影响。针对ResNet18、LeNet、ViT三种典型深度学习模型,系统分析其不确定度特征与性能随Dropout率的动态演化规律。实验以MNIST数据集为测试基准,结果表明随着Dropout率的调整,蒙特卡洛Dropout法捕捉到的模型不确定度呈现显著的动态变化。此外,还系统梳理了深度学习模型不确定度的核心来源、当前不确定度评定方法的研究现状,结合实验结果进一步总结了模型不确定度特征随Dropout率的演化规律,并针对蒙特卡洛Dropout法的局限性提出了未来可探索的方向。

       

      Abstract: With the rapid development of artificial intelligence, deep learning technology has been widely applied in fields such as medical diagnosis and autonomous driving. However, the inherent black-box nature and structural complexity of deep learning models make their uncertainty neither directly derivable from physical principles nor explicitly expressible through clear functional formulas—this has become a critical bottleneck restricting the deployment of models in high-reliability scenarios. Monte Carlo Dropout is a commonly used method for evaluating the uncertainty of deep learning models; in this study, we use it as the core tool to design experiments exploring the effects of different dropout rates on model uncertainty and performance. Focusing on three typical deep learning models (ResNet18, LeNet, and ViT), we systematically analyzed the dynamic evolution patterns of their uncertainty characteristics and performance with varying dropout rates. Experiments were conducted on the MNIST dataset, and the results showed that the model uncertainty captured by the Monte Carlo Dropout exhibited significant dynamic changes as the dropout rate was adjusted. Furthermore, this study systematically describes the core sources of uncertainty in deep learning models and the current research status of uncertainty measurement methods. Combined with the experimental results, we further summarized the evolution patterns of model uncertainty characteristics with dropout rates. Besides, in view of the limitations of Monte Carlo Dropout, we proposed some directions for future work.

       

    /

    返回文章
    返回