• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

泛古陆:一种用于在边缘、雾和云层中自动生成基础设施和部署分析管道的 MLOps 工具。

Pangea: An MLOps Tool for Automatically Generating Infrastructure and Deploying Analytic Pipelines in Edge, Fog and Cloud Layers.

机构信息

Digital, TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnológico de Álava Albert Einstein 28, Vitoria-Gasteiz, 01510 Álava, Spain.

Mining Engineering and Mineral Economics, Montanuniversitaet Leoben, Erzherzog-Johann-Straße 3, 8700 Leoben, Austria.

出版信息

Sensors (Basel). 2022 Jun 11;22(12):4425. doi: 10.3390/s22124425.

DOI:10.3390/s22124425
PMID:35746207
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9228186/
Abstract

Development and operations (DevOps), artificial intelligence (AI), big data and edge-fog-cloud are disruptive technologies that may produce a radical transformation of the industry. Nevertheless, there are still major challenges to efficiently applying them in order to optimise productivity. Some of them are addressed in this article, concretely, with respect to the adequate management of information technology (IT) infrastructures for automated analysis processes in critical fields such as the mining industry. In this area, this paper presents a tool called Pangea aimed at automatically generating suitable execution environments for deploying analytic pipelines. These pipelines are decomposed into various steps to execute each one in the most suitable environment (edge, fog, cloud or on-premise) minimising latency and optimising the use of both hardware and software resources. Pangea is focused in three distinct objectives: (1) generating the required infrastructure if it does not previously exist; (2) provisioning it with the necessary requirements to run the pipelines (i.e., configuring each host operative system and software, install dependencies and download the code to execute); and (3) deploying the pipelines. In order to facilitate the use of the architecture, a representational state transfer application programming interface (REST API) is defined to interact with it. Therefore, in turn, a web client is proposed. Finally, it is worth noting that in addition to the production mode, a local development environment can be generated for testing and benchmarking purposes.

摘要

开发和运营 (DevOps)、人工智能 (AI)、大数据和边缘雾云是颠覆性技术,可能会彻底改变行业。然而,为了有效地应用这些技术以优化生产力,仍然存在重大挑战。本文针对其中一些挑战进行了探讨,具体来说,就是针对在采矿等关键领域的自动化分析流程中,对信息技术 (IT) 基础设施进行适当管理。在这一领域,本文提出了一个名为 Pangea 的工具,旨在自动生成适合部署分析管道的执行环境。这些管道被分解为多个步骤,以便在最适合的环境(边缘、雾、云或本地)中执行每一个步骤,从而最小化延迟并优化硬件和软件资源的使用。Pangea 专注于三个不同的目标:(1) 如果不存在所需的基础设施,则生成所需的基础设施;(2) 为运行管道提供必要的要求(即配置每个主机操作系统和软件、安装依赖项并下载要执行的代码);以及 (3) 部署管道。为了方便使用该架构,定义了一个代表性状态传输应用程序编程接口 (REST API) 与之交互。因此,又提出了一个 Web 客户端。最后值得注意的是,除了生产模式外,还可以生成一个用于测试和基准测试的本地开发环境。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/16a6b93103c9/sensors-22-04425-g016.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/6c41f3f9fdc3/sensors-22-04425-g017.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/36791a2167bc/sensors-22-04425-g018.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/5d58435b4380/sensors-22-04425-g019.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8da8f7111a67/sensors-22-04425-g020a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/11119bb2fb52/sensors-22-04425-g021.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/adeb4b38d373/sensors-22-04425-g022.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/5416768b4d9a/sensors-22-04425-g023a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/9198aa8b064e/sensors-22-04425-g024.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8f672fd573a3/sensors-22-04425-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8181846104ae/sensors-22-04425-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/5c5f63a5e58d/sensors-22-04425-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/aaf47c97f5cd/sensors-22-04425-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/201f76ee94da/sensors-22-04425-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/4b314278493f/sensors-22-04425-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/dcf1262b17da/sensors-22-04425-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/49a69999de50/sensors-22-04425-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/c1c29958c208/sensors-22-04425-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/2a5e493a0241/sensors-22-04425-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/789f3d42ff49/sensors-22-04425-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/d40c4ff9e284/sensors-22-04425-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/87bfa8d3932c/sensors-22-04425-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8dac143eb2ff/sensors-22-04425-g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8cd30c40781e/sensors-22-04425-g015.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/16a6b93103c9/sensors-22-04425-g016.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/6c41f3f9fdc3/sensors-22-04425-g017.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/36791a2167bc/sensors-22-04425-g018.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/5d58435b4380/sensors-22-04425-g019.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8da8f7111a67/sensors-22-04425-g020a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/11119bb2fb52/sensors-22-04425-g021.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/adeb4b38d373/sensors-22-04425-g022.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/5416768b4d9a/sensors-22-04425-g023a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/9198aa8b064e/sensors-22-04425-g024.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8f672fd573a3/sensors-22-04425-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8181846104ae/sensors-22-04425-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/5c5f63a5e58d/sensors-22-04425-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/aaf47c97f5cd/sensors-22-04425-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/201f76ee94da/sensors-22-04425-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/4b314278493f/sensors-22-04425-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/dcf1262b17da/sensors-22-04425-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/49a69999de50/sensors-22-04425-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/c1c29958c208/sensors-22-04425-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/2a5e493a0241/sensors-22-04425-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/789f3d42ff49/sensors-22-04425-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/d40c4ff9e284/sensors-22-04425-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/87bfa8d3932c/sensors-22-04425-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8dac143eb2ff/sensors-22-04425-g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/8cd30c40781e/sensors-22-04425-g015.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/113e/9228186/16a6b93103c9/sensors-22-04425-g016.jpg

相似文献

1
Pangea: An MLOps Tool for Automatically Generating Infrastructure and Deploying Analytic Pipelines in Edge, Fog and Cloud Layers.泛古陆:一种用于在边缘、雾和云层中自动生成基础设施和部署分析管道的 MLOps 工具。
Sensors (Basel). 2022 Jun 11;22(12):4425. doi: 10.3390/s22124425.
2
Edge, Fog, and Cloud Against Disease: The Potential of High-Performance Cloud Computing for Pharma Drug Discovery.边缘计算、雾计算和云计算对抗疾病:高性能云计算在制药药物发现中的潜力。
Methods Mol Biol. 2024;2716:181-202. doi: 10.1007/978-1-0716-3449-3_8.
3
Client Applications and Server-Side Docker for Management of RNASeq and/or VariantSeq Workflows and Pipelines of the GPRO Suite.客户端应用程序和服务器端 Docker 用于管理 GPRO 套件的 RNASeq 和/或 VariantSeq 工作流程和管道。
Genes (Basel). 2023 Jan 19;14(2):267. doi: 10.3390/genes14020267.
4
Smart Data Placement Using Storage-as-a-Service Model for Big Data Pipelines.基于存储即服务模型的大数据管道智能数据放置。
Sensors (Basel). 2023 Jan 4;23(2):564. doi: 10.3390/s23020564.
5
Imtidad: A Reference Architecture and a Case Study on Developing Distributed AI Services for Skin Disease Diagnosis over Cloud, Fog and Edge.Imtidad:用于在云、雾和边缘上开发皮肤病诊断分布式 AI 服务的参考架构和案例研究。
Sensors (Basel). 2022 Feb 26;22(5):1854. doi: 10.3390/s22051854.
6
Tibanna: software for scalable execution of portable pipelines on the cloud.Tibanna:用于在云端可扩展执行可移植管道的软件。
Bioinformatics. 2019 Nov 1;35(21):4424-4426. doi: 10.1093/bioinformatics/btz379.
7
The machine learning life cycle and the cloud: implications for drug discovery.机器学习生命周期与云:对药物发现的影响。
Expert Opin Drug Discov. 2021 Sep;16(9):1071-1079. doi: 10.1080/17460441.2021.1932812. Epub 2021 May 31.
8
CloudDOE: a user-friendly tool for deploying Hadoop clouds and analyzing high-throughput sequencing data with MapReduce.CloudDOE:一款用于部署Hadoop云并使用MapReduce分析高通量测序数据的用户友好型工具。
PLoS One. 2014 Jun 4;9(6):e98146. doi: 10.1371/journal.pone.0098146. eCollection 2014.
9
Osmotic Cloud-Edge Intelligence for IoT-Based Cyber-Physical Systems.用于基于物联网的信息物理系统的渗透式云边缘智能
Sensors (Basel). 2022 Mar 10;22(6):2166. doi: 10.3390/s22062166.
10
The future of Artificial Intelligence for the BioTech Big Data landscape.生物技术大数据领域的人工智能的未来。
Curr Opin Biotechnol. 2022 Aug;76:102714. doi: 10.1016/j.copbio.2022.102714. Epub 2022 Apr 29.

引用本文的文献

1
ArtifactOps and ArtifactDL: a methodology and a language for conceptualizing and operationalising different types of pipelines.工件操作与工件深度学习:一种用于概念化和实施不同类型管道的方法和语言。
J Cloud Comput (Heidelb). 2025;14(1):42. doi: 10.1186/s13677-025-00761-w. Epub 2025 Aug 7.
2
A Study on ML-Based Software Defect Detection for Security Traceability in Smart Healthcare Applications.基于机器学习的软件缺陷检测在智能医疗保健应用中的安全性可追踪性研究。
Sensors (Basel). 2023 Mar 26;23(7):3470. doi: 10.3390/s23073470.
3
[Chair of Mining Engineering and Mineral Economics-the Future].

本文引用的文献

1
PADL: A Modeling and Deployment Language for Advanced Analytical Services.PADL:高级分析服务的建模和部署语言。
Sensors (Basel). 2020 Nov 24;20(23):6712. doi: 10.3390/s20236712.
2
A Review of Rock Bolt Monitoring Using Smart Sensors.使用智能传感器对锚杆进行监测的综述。
Sensors (Basel). 2017 Apr 5;17(4):776. doi: 10.3390/s17040776.
[采矿工程与矿物经济学主席——未来]
Berg Huttenmannische Monatshefte. 2023;168(2):37-44. doi: 10.1007/s00501-023-01322-x. Epub 2023 Jan 27.