Tian Chao
Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA.
Entropy (Basel). 2018 Aug 13;20(8):603. doi: 10.3390/e20080603.
We illustrate how computer-aided methods can be used to investigate the fundamental limits of the caching systems, which are significantly different from the conventional analytical approach usually seen in the information theory literature. The linear programming (LP) outer bound of the entropy space serves as the starting point of this approach; however, our effort goes significantly beyond using it to prove information inequalities. We first identify and formalize the symmetry structure in the problem, which enables us to show the existence of optimal symmetric solutions. A symmetry-reduced linear program is then used to identify the boundary of the memory-transmission-rate tradeoff for several small cases, for which we obtain a set of tight outer bounds. General hypotheses on the optimal tradeoff region are formed from these computed data, which are then analytically proven. This leads to a complete characterization of the optimal tradeoff for systems with only two users, and certain partial characterization for systems with only two files. Next, we show that by carefully analyzing the joint entropy structure of the outer bounds for certain cases, a novel code construction can be reverse-engineered, which eventually leads to a general class of codes. Finally, we show that outer bounds can be computed through strategically relaxing the LP in different ways, which can be used to explore the problem computationally. This allows us firstly to deduce generic characteristic of the converse proof, and secondly to compute outer bounds for larger problem cases, despite the seemingly impossible computation scale.
我们阐述了如何使用计算机辅助方法来研究缓存系统的基本限制,这与信息论文献中常见的传统分析方法有显著不同。熵空间的线性规划(LP)外边界是此方法的起点;然而,我们的工作远不止于用它来证明信息不等式。我们首先识别并形式化问题中的对称结构,这使我们能够证明最优对称解的存在性。然后,使用一个对称简化的线性规划来确定几个小案例中内存 - 传输速率权衡的边界,我们由此获得了一组紧密的外边界。基于这些计算数据形成了关于最优权衡区域的一般假设,然后进行了分析证明。这导致了对仅具有两个用户的系统的最优权衡的完整刻画,以及对仅具有两个文件的系统的某些部分刻画。接下来,我们表明,通过仔细分析某些情况下外边界的联合熵结构,可以逆向设计一种新颖的编码构造,最终得到一类通用的码。最后,我们表明可以通过以不同方式策略性地放宽线性规划来计算外边界,这可用于通过计算探索该问题。这首先使我们能够推断逆证的一般特征,其次能够计算更大问题案例的外边界,尽管计算规模看似不可能。