JAPANESE
The results of this project were reported at the "Moonshot Goal 3 Public Symposium 2025" held at the Miraikan, National Museum of Emerging Science and Innovation.
The Moonshot Research and Development Program
“Realization of Artificial Intelligence (AI) robots that autonomously learn, adapt to their environment, evolve itself in intelligence, and act alongside human beings, by 2050.”
The results of this project were reported at the "Moonshot Goal 3 Public Symposium 2025" held at the Miraikan, National Museum of Emerging Science and Innovation.
System Integration Division Conference of Society of Instrument and Control Engineers (SICE) was held in Morioka from December 18th to 20th, 2024. At the conference, we held an organized session focused on this project and presented 16 technical papers.
A team from Seikei University conducted a public demonstration experiment of an automated crushed stone transport system at SK Material's Agano Field.
Osaka University's separable and combinable robot that can be reconfigured for unspecified environments was exhibited at the IEEE ICRA 2024 (International Conference on Robotics and Automation).
Osaka University's i-CentiPot-Ammonite, a separable and combinable robot that can be reconfigured for unspecified environments, and BRAINS, a general-purpose transport container for the robot, were proposed.
The results of the visit will be used in the demonstration experiments of the development equipment.
A demonstration of the force control of the next-generation work equipment Cafe developed in this project was given at a remote construction demonstration by the MLIT.
Tohoku University conducted a demonstration of ground strength estimation and moving using bucket excavation. The photo shows a mini excavator moving with avoiding the soft ground by estimating the ground strength.
We carried out a transportation and installation test of a topographical measurement sensor pod in order to survey the topography of river channel blockage.
Tokyo University, Seikei University, Public works research institute, Osaka University, and Kyushu University jointly conducted an experimental demonstrations of an automatic sediment transport system at the outdoor field of Kyushu University.
We performed the experimental demonstrations on lunar construction works using five different types of small robotic platforms, deployed at JAXA’s test field.
An outdoor experiment on rough terrain was conducted using a flexible mobile robot developed by Osaka University. The photo shows i-Centipot Amphibian Jr. flexibly moving from water to land.
We performed experimental tests on robotic mobility and construction works using the small robotic platforms at JAXA’s test field.
An outdoor experiment was conducted using a flexible mobile robot developed by Osaka University. The photo shows the ''d-FlexCraw'' running outdoor experiment field.
We have conducted a demonstration of sensing equipment，a communication test, and aerial drone photography at the Futase Dam (Chichibu City).
We conducted compaction experiments using a vibratory roller to verify the ground stiffness estimation method by Kyushu University in the experimental pit.
We developed a stiffness evaluation method for compacted ground using distributed sensor pods.
We developed a method for estimating the position of construction vehicles using 3D point clouds obtained from sensor pods.
We experimented on the remote and autonomous driving control for a wheel loader with our developed retrofitted device.
PWRI has developed and released “OPERA” on GitHub.
We have conducted preliminary tests of the small robotic platforms at the sand field at JAXA
The results of this program were reported at the Moonshot R&D Symposium.
Organized Session on Disaster Response Robot System was held at the conference SI2024,
The University of Tokyo and Seikei University jointly conducted of an automatic transport system at the field of SK Material Corporation.
Osaka University’s Disaster Response Robot System was exhibited at the international conference ICRA2024.
A press demonstration of a disaster response robot system (i-CentiPot-Ammonite, BRAINS) based on “open design” was held at Osaka University.
We, the CAFE project, are working on the research and development of “Collaborative AI robots for adaptation of diverse environments and innovation of infrastructure construction” in the group of Moonshot Goal #3 “AI robots that learn and act by themselves and coexist with people.” The CAFE project is derived from the Collaborative AI Field robot Everywhere. Starting in 2024, we will transition to a new organizational structure, aiming for system integration of the technologies we have developed so far.
Disaster response at the site of
a natural disaster in 2050
In Japan, where we live, various natural disasters frequently occur across the country. To protect the lives of the people living here and minimize the damage caused by these disasters, further technological development for emergency restoration is desired. Therefore, in this project, We will conduct research and development of “collaborative AI robots” that can respond flexibly to different situations and perform tasks in difficult environments such as disaster sites. This technology will also be useful in the construction and maintenance of infrastructure on the ground.
The illustration on the left depicts the concept of emergency restoration at a natural disaster site in 2050. Multiple field robots assess the disaster situation accurately based on sensing data, and then engage in collaborative work to handle unexpected situations while carrying out emergency restoration. As a milestone for this project by 2025, we aim to develop a prototype system of multiple collaborative AI robots capable of flexibly responding to unforeseen situations, specifically to mitigate the impact of natural disasters, with a focus on river blockage disasters.
The overarching goal of this research and development project is “to achieve infrastructure construction adapted to various environments through a collaborative AI robot system.” To realize this goal, we have established three research and development themes: 1. AI Robot System Revolutionizing Earthwork (hardware), 2. Dynamic Collaboration System for Multiple Robots (AI controlling multiple robots), and 3. Sensor Pod System Overseeing the Site (sensing technology and AI evaluating the environment). We have been advancing research and development on these themes in parallel.
From 2024 onwards, as shown in the figure on the right, we will focus on advancing robotic systems capable of responding to natural disasters, particularly river blockage disasters. Alongside technological innovations, we aim to integrate these technologies into a cohesive system.
The project named “Collaborative AI robots for adaptation of diverse environments and innovation of infrastructure construction,” aims to develop collaborative field robots that can be useful in “natural disaster response.” To achieve this goal, robots must be able to flexibly respond to various situations. In this project, we aim to achieve this goal through a variety of approaches.
The introduction to this project is provided in the section “Overview of CAFE Project,” and I, the project manager, would like to share three things that are important to me in this project.
The first is the basic philosophy of this project. The basic philosophy of this project is “to develop technology that is useful to people.” It is the same basic philosophy that I have always cherished in my robotics research. I do not want to excuse myself from saying, “I completed my research, and it will be practical use if somebody complete other required parts.” in this policy.
The second aspect is the horizontal connection between the researchers and engineers. This project requires interdisciplinary cooperation, and it will not be possible without “civil engineering,” “mechanical engineering,” and “AI.” Therefore, we would like to promote the research and development, where researchers from each field respect each other's field and closely exchange information to strengthen the horizontal collaboration.
The third is a field-oriented approach. In this project, we do not want to artificially create and demonstrate a field where robots can efficiently operate. Instead, we want to develop robots that can operate in actual fields.
The members of this project are very powerful researchers and engineers who are currently active in their respective research fields. I am happy to work with them. Please look forward to our future research.
Keiji Nagatani, Project Manager
He received his master’s degree from Osaka University and Ph.D. (Engineering) from the Graduate School of Engineering Science in 1984. He is a professor at the Department of Mechanical Engineering, Graduate School of Engineering, Osaka University, Director of Creative Design Studio on Technology, and Director of the Komatsu MIRAI Construction Equipment Cooperative Research Center, where he researches on robotics and control engineering.
Koichi Osuka
Professor in Graduate School of Engineering, Osaka University
He received his master’s degree from the Graduate School of Tsukuba University in 1993 and Ph.D. (Engineering) from Bielefeld University in 2010. He is currently engaged in the research and development of field robotics for agriculture, civil engineering and construction, as well as marine applications at Yanmar Holdings.
Hisashi Sugiura
Group Leader of Robotics Group, System Research Center, R&D Center, Innovation and Technology Division, Yanmar Holdings Co.
Part-time lecturer at Ritsumeikan and Meijo University
He received his Ph.D. from Yokohama National University, the Doctoral Program in 1990. After working for Toshiba Corporation, Micromachine Center, and Okayama University, he was appointed to his current position in 2014. He is the president of s-muscle Co. Ltd., H-MUSCLE Co. Ltd., and the representative of the new academic field “Science of Soft Robots.”
Koichi Suzumori
Professor of Institute of Science Tokyo
He received his Ph.D. from the Doctoral Program of Engineering, Kyushu University, in 1999. He researches on the applications of geospatial information and disaster prevention based on rock engineering and geo-environmental engineering.
Yasuhiro Mitani
Professor of Disaster Risk Reduction Research Center, Graduate School of Engineering, Kyusyu University
He received his Ph.D. from Wayne State University in 2010. He worked as a research associate at Yonsei University, Ehime University, and is currently a project associate professor at the University of Tokyo. His research interest is in civil engineering, especially in the application of ICT technology to the maintenance and management of bridges and tunnels.
Pang-jo Chun
Project Associate Professor, The University of Tokyo
He received his B. Sc., M.Sc., and Ph.D. degrees from the University of Tokyo in 1994, 1996, and 1999, respectively. He is currently a Professor in Computer Vision at Tohoku University, and serves as a leader of the infrastructure management robotics team at RIKEN Center since 2016. His research interests are in the fields of computer vision and machine learning.
Takayuki Okatani
Team Leader of RIKEN, Japan
He graduated from the Faculty of Engineering, Tokai University, in 1983. He engages in the development and research of construction ICT, automation of construction machinery, and unmanned construction technology at Kumagai Gumi Co., Ltd.
Shigeo Kitahara
General Manager, ICT Promotion Office, Civil Engineering Division, Kumagai Gumi Co., Ltd.
He received a master’s degree from the Graduate School of Agriculture, Iwate University Master Course in 1985. Currently, he engages in research on the planning and design of volcano robots for natural disaster prevention during volcanic eruptions.
Toru Shimada
Manager of Business Planning,
Public Consultant Division Kokusai Kogyo Co., Ltd.,
He received M. S. and Dr. Eng. from the University of Tokyo in 1984 and 1989. He became a professor of Research into Artifacts, Center for Engineering (RACE) of the University of Tokyo, a professor at the School of Engineering since 2009, and the director of RACE since 2019. His main research interests are service robotics, distributed autonomous robotic systems, embodied brain science systems, and cognitive ergonomics.
Hajime Asama
Professor, The University of Tokyo
He received his Ph.D. in Information Science from NAIST in 2007. He is currently a tenure-track associate professor and director of the Robot Learning Lab. His research interests include machine learning and its applications in real-world robots.
Takamitsu Matsubara
Professor in the Nara Institute of Science and Technology
He received his Ph.D. from the Tohoku University Doctoral Program in 1986. His main research field is terramechanics.
Hiroshi Takahashi
Professor of Graduate School of Environmental Studies,
Tohoku University
He received his Ph.D. degree from the Department of Mechanical Engineering Science, Tokyo Institute of Technology in 1998. He is a JSME Fellow, SICE Fellow, and RSJ Fellow. His current research interests include legged robot control, computer vision, multiple mobile robots, space robots, service robots, medical imaging, biometrics, and dementia care.
Ryo Kurazume
Professor at the Graduate School of Information Science and Electrical Engineering, Kyushu University
He received his Ph.D. from the University of Tsukuba, Japan, in 2007. After working at the Ibaraki Prefectural Institute of Industrial Technology, the National Institute of Advanced Industrial Science and Technology, the University of Tsukuba, Seikei University, and Hirosaki University, currently holds the present position. Engaged in research on the social implementation of robotic control technologies and haptic technologies.
Toshinobu Takei
Associate Professor, Seikei University.
Hiromitsu Fujii
Associate Professor in Chiba Inst. of Technology
Robert received his Ph.D. in Mechanical Engineering from the Massachusetts Institute of Technology (MIT) in 2018. He is an Assistant Professor of Robotics at ETH Zurich, where he leads the Soft Robotics Lab. He is also a core faculty member at the ETH AI Center, the ETH Center for Robotics, and the ETH-MPI Center for Learning Systems. His research focuses on musculoskeletal robotics, soft robotics, and biohybrid robotics, aiming to develop lifelike robots that interact safely with humans and the environment.
Robert Katzschmann
Assistant Professor, ETH Zurich
01/21/2025
Journal
Jeongho Ahn, Kazuto Nakashima, Koki Yoshino, Yumi Iwashita, Ryo Kurazume (2025), “Gait Sequence Upsampling using Diffusion Models for single LiDAR sensors”, The 2025 IEEE/SICE International Symposium on System Integration (SII2025)., January, 2025. pp. 658-664.
01/21/2025
Journal
Hiroto Kodama, Hiroyuki Nabae, Gen Endo, Koichi Suzumori (2025), “Verification of the Effect of Design Parameters on the Radius of Curvature of Vine-like, Power Soft Gripper”, The 2025 IEEE/SICE International Symposium on System Integration (SII2025)., January, 2025. pp. 702-706.
01/21/2025
Journal
Koki Yoshino, Kazuto Nakashima, Jeongho Ahn, Yumi Iwashita, Ryo Kurazume (2025), “S2Gait: RGB-based Gait Recognition with Style Feature Sampling Data Augmentation”, The 2025 IEEE/SICE International Symposium on System Integration (SII2025)., January, 2025. pp. 375-380.
01/01/2025
Journal
Jorge Ruben Casir Ricano, Sota Yuasa, Ryota Hino, Tomoki Koshi, Tatsuya Oyama, Kenji Nagaoka (2025), “Resilient Mobility of a Four-Wheeled Planetary Rover with Active Suspension”, Acta Astronautica., January, 2025. Vol. 229, pp. 418-429.
11/12/2024
Journal
Ryuichi Maeda, Tomoya Kouno, Kohei Matsumoto, Yuichiro Kasahara, Tomoya Itsuka, Kazuto Nakashima, Yusuke Tamaishi, Ryo Kurazurne (2024), “Sensor Pods and ROS2-TMS for Construction for Cyber-Physical System at Earthwork Sites”, 2024 IEEE International Symposium on Safety Security Rescue Robotics (SSRR)., November, 2024. pp. 58-63.
10/29/2024
Journal
Yuichiro Sueoka, Yuki Kato, Takahiro Yoshida, Koichi Osuka, Ryosuke Yajima, Shota Chikushi, Keiji Nagatani, Hajime Asama (2024), “Adaptivity of a Multi-Robot Coordination System based on Functional Expressions using Large Language Models”, The 17th International Symposium on Distributed Autonomous Robotic Systems 2024(DARS2024)., October, 2024. pp. 19.
10/29/2024
Journal
Takahiro Yoshida, Yuichiro Sueoka, Koichi Osuka (2024), “Verification of a Two‐Step Inference Model for Cooperative Evaluation of Robot Actions Using Foundation Models”, The 17th International Symposium on Distributed Autonomous Robotic Systems 2024(DARS2024)., October, 2024. pp. 55.
10/29/2024
Journal
Yuichiro Sueoka, Takahiro Yoshida, Koichi Osuka (2024), “Reinforcement Learning of Scalable, Flexible, and Robust Cooperative Transport Behavior Using the Transformer Encoder”, The 17th International Symposium on Distributed Autonomous Robotic Systems 2024(DARS2024)., October, 2024. pp. 20.
10/14/2024
Journal
Yuki Kato, Takahiro Yoshida, Yuichiro Sueoka, Koichi Osuka, Ryosuke Yajima, Keiji Nagatani, Hajime Asama (2024), “Design of a Multi-robot Coordination System based on Functional Expressions Using Large Language Models”, The IEEE/RSJ International Conference on Intelligent Robots and Systems 2024 (IROS2024)., October, 2024. pp. 3447-3454.
10/14/2024
Journal
Yunhao Feng, Hiroto Kodama, Tohru Ide, Akina Yamamoto, Hiroyuki Nabae, Koichi Suzumori (2024), “Vine-Like Device for Quick Camera Mounting Supporting Teleoperation”, The IEEE/RSJ International Conference on Intelligent Robots and Systems 2024 (IROS2024) Workshop., October, 2024.
