Shahria Md Tanzil, Rahman Mohammad H
Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA.
Mechanical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA.
Sensors (Basel). 2024 Nov 27;24(23):7566. doi: 10.3390/s24237566.
The increasing number of individuals with disabilities-over 61 million adults in the United States alone-underscores the urgent need for technologies that enhance autonomy and independence. Among these individuals, millions rely on wheelchairs and often require assistance from another person with activities of daily living (ADLs), such as eating, grooming, and dressing. Wheelchair-mounted assistive robotic arms offer a promising solution to enhance independence, but their complex control interfaces can be challenging for users. Automating control through deep learning-based object detection models presents a viable pathway to simplify operation, yet progress is impeded by the absence of specialized datasets tailored for ADL objects suitable for robotic manipulation in home environments. To bridge this gap, we present a novel ADL object dataset explicitly designed for training deep learning models in assistive robotic applications. We curated over 112,000 high-quality images from four major open-source datasets-COCO, Open Images, LVIS, and Roboflow Universe-focusing on objects pertinent to daily living tasks. Annotations were standardized to the YOLO Darknet format, and data quality was enhanced through a rigorous filtering process involving a pre-trained YOLOv5x model and manual validation. Our dataset provides a valuable resource that facilitates the development of more effective and user-friendly semi-autonomous control systems for assistive robots. By offering a focused collection of ADL-related objects, we aim to advance assistive technologies that empower individuals with mobility impairments, addressing a pressing societal need and laying the foundation for future innovations in human-robot interaction within home settings.
残疾人数不断增加——仅在美国就有超过6100万成年人——凸显了对增强自主性和独立性的技术的迫切需求。在这些人中,数百万人依赖轮椅,在诸如进食、洗漱和穿衣等日常生活活动(ADL)中通常需要他人协助。安装在轮椅上的辅助机器人手臂为增强独立性提供了一个有前景的解决方案,但其复杂的控制界面可能对用户构成挑战。通过基于深度学习的目标检测模型实现自动化控制为简化操作提供了一条可行途径,但由于缺乏专门针对适合在家庭环境中进行机器人操作的ADL对象的数据集,进展受到阻碍。为了弥补这一差距,我们提出了一个专门为辅助机器人应用中的深度学习模型训练而设计的新型ADL对象数据集。我们从四个主要的开源数据集——COCO、开放图像、LVIS和Roboflow Universe中精心挑选了超过112,000张高质量图像,重点关注与日常生活任务相关的对象。注释被标准化为YOLO Darknet格式,并通过一个严格的过滤过程提高数据质量,该过程涉及一个预训练的YOLOv5x模型和人工验证。我们的数据集提供了一个宝贵的资源,有助于开发更有效、用户友好的辅助机器人半自主控制系统。通过提供一组专注于与ADL相关对象的集合,我们旨在推进辅助技术,使行动不便的人获得能力,满足紧迫的社会需求,并为家庭环境中未来的人机交互创新奠定基础。