Galitsky Boris, Ilvovsky Dmitry, Goldberg Saveli
Knowledge-Trail, San Jose, CA 93635, USA.
Computer Science Faculty, HSE University, Moscow 101000, Russia.
Entropy (Basel). 2023 Jun 12;25(6):924. doi: 10.3390/e25060924.
In spite of great progress in recent years, deep learning (DNN) and transformers have strong limitations for supporting human-machine teams due to a lack of explainability, information on what exactly was generalized, and machinery to be integrated with various reasoning techniques, and weak defense against possible adversarial attacks of opponent team members. Due to these shortcomings, stand-alone DNNs have limited support for human-machine teams. We propose a architecture that overcomes these limitations by integrating deep learning with explainable nearest neighbor learning (kNN) to form the object level, having a deductive reasoning-based meta-level control learning process, and performing validation and correction of predictions in a way that is more interpretable by peer team members. We address our proposal from structural and maximum entropy production perspectives.
尽管近年来取得了巨大进展,但深度学习(DNN)和变压器由于缺乏可解释性、关于具体泛化内容的信息、与各种推理技术集成的机制,以及对对手团队成员可能的对抗性攻击的弱防御能力,在支持人机团队方面存在很大局限性。由于这些缺点,独立的DNN对人机团队的支持有限。我们提出一种架构,通过将深度学习与可解释的最近邻学习(kNN)集成,形成对象级别,具有基于演绎推理的元级别控制学习过程,并以团队成员更易解释的方式对预测进行验证和校正,从而克服这些局限性。我们从结构和最大熵产生的角度阐述我们的提议。