We developed a stiffness evaluation method for compacted ground using distributed sensor pods.
The Moonshot Research and Development Program
“Realization of Artificial Intelligence (AI) robots that autonomously learn, adapt to their environment, evolve itself in intelligence, and act alongside human beings, by 2050.”
We developed a stiffness evaluation method for compacted ground using distributed sensor pods.
We developed a method for estimating the position of construction vehicles using 3D point clouds obtained from sensor pods.
We experimented on the remote and autonomous driving control for a wheel loader with our developed retrofitted device.
PWRI has developed and released “OPERA” on GitHub.
We have conducted preliminary tests of the small robotic platforms at the sand field at JAXA.
We observed a demonstration of autonomous construction using an open developed by the PWRI. The photo shows an explanation of the construction equipment.
A ground excavation experiment using a mini hydraulic excavator was conducted at the Sanbongi field in Osaki city. The photos show the excavation of the unsaturated ground.
We conducted a bridge inspection test on the Sakamoto Bridge in Yamanashi Pref. The photo shows the drone flying and getting close to the bridge.
In a 20-meter-deep pool at the PWRI, we conducted a test of passive depth measurement device that sinks the weight below the water to measure the depth.
A measurement test using sensor pods (to detect the ground vibration generated by the vibrating roller) have been conducted.
We visited river channel blockage sites. This photo shows the current state of a river channel blockage that occurred due to the 2004 Chuetsu Earthquake.
We will build an in-situ experimental field in the Ito Campus of Kyushu University.
The basic philosophy of this project, open design, has been published in Advanced robotics.
We, the CAFE project, are working on the research and development of “Collaborative AI robots for adaptation of diverse environments and innovation of infrastructure construction” in the group of Moonshot Goal #3 “AI robots that learn and act by themselves and coexist with people.” The CAFE project is derived from the Collaborative AI Field robot Everywhere.
Disaster response at the site of
a natural disaster in 2050
In Japan, various natural disasters frequently occur in many areas. To protect the people living in such areas and minimize the damage caused by disasters, techniques for emergency recovery must be developed.
Considering space, the United States and other countries, including Japan, are developing a moonbase under international cooperation, such as in the Artemis Project.
In this project, we have set the moonshot goals of “Natural disaster response” and “Development of a moonbase for manned exploration on the Moon” with a robotic technology that we aim to achieve by 2050.
The left image shows disaster response at the site of a natural disaster in 2050. After accurately analyzing the disaster situation based on sensing data, multiple field robots work together to recover from the disaster by responding to unexpected situations.
Infrastructure construction on the Moon in 2050
The right image shows infrastructure construction on the Moon in 2050. In this illustration, multiple field robots autonomously and dynamically collaborate to construct the infrastructure as well as respond to the unexpected situations.
Initially, the technologies required for disaster response and lunar development may seem different. However, they have one thing in common: they require robotic technologies that can adapt to various situations in various environments. Therefore, our research goal of the 5-year CAFE project is to develop a field robot equipped with such technologies.
In the CAFE project, we aim to design robots that can flexibly respond to various situations. To proceed with this project, we have divided the “ability of responding flexibly” into three elements: “body,” “evaluation,” and “control.” We plan to conduct the research and development in parallel.
To realize a robot “body” that can flexibly adapt to any environment, we will construct “robot hardware that can adapt to any environment.” For flexible “evaluation” within diverse environments, we will research and develop “many modal AI for environmental evaluation,” that evaluate the environment using various sensing data. Furthermore, to achieve multi-robot “control,” we will develop “physical AI and dynamic collaboration” for multiple robots. By combining these three technologies, we can design field robots that flexibly respond to diverse environments. These robots may be used in the fields of “emergency recovery from natural disasters” and “constructing a base on the Moon.”
In the CAFE project, we will promote robotic technologies that can adapt to diverse environments and build infrastructure.
A process diagram of the project is presented here. Although there are many similarities between natural disaster response and lunar infrastructure construction, there are differences in the degree of necessity considering environmental unawareness and robot autonomy.
In this figure, the horizontal axis represents “environmental unawareness,” and the vertical axis represents “necessity of robot autonomy.” For example, the technology required to respond to natural disasters is located at the right side of the diagram because the problem of environmental unawareness is significant compared to the autonomy. However, the technology required for constructing a base on the Moon is located at the upper side of the figure because the necessity of robot autonomy is greater than the problem of environmental unawareness.
Therefore, in the CAFE project, to realize these two technologies, we have named the base technology as “adaptive construction,” and placed it between the technologies of “natural disaster response” and “constructing a base on the Moon.” To realize “adaptive construction,” we will promote research and development in the three areas of “body,” “evaluation,” and “control.”
Simultaneously, we will research and develop more specific robotic technologies required for “constructing a base on the Moon” and “natural disaster response.”
The project named “Collaborative AI robots for adaptation of diverse environments and innovation of infrastructure construction,” aims to develop collaborative field robots that can be useful in “natural disaster response” and “constructing a base on the Moon.” To achieve this goal, robots must be able to flexibly respond to various situations. In this project, we aim to achieve this goal through a variety of approaches.
The introduction to this project is provided in the section “Overview of CAFE Project,” and I, the project manager, would like to share three things that are important to me in this project.
The first is the basic philosophy of this project. The basic philosophy of this project is “to develop technology that is useful to people.” It is the same basic philosophy that I have always cherished in my robotics research. I do not want to excuse myself from saying, “I completed my research, and it will be practical use if somebody complete other required parts.” in this policy.
The second aspect is the horizontal connection between the researchers and engineers. This project requires interdisciplinary cooperation, and it will not be possible without “civil engineering,” “mechanical engineering,” and “AI.” Therefore, we would like to promote the research and development, where researchers from each field respect each other's field and closely exchange information to strengthen the horizontal collaboration.
The third is a field-oriented approach. In this project, we do not want to artificially create and demonstrate a field where robots can efficiently operate. Instead, we want to develop robots that can operate in actual fields.
The members of this project are very powerful researchers and engineers who are currently active in their respective research fields. I am happy to work with them. Please look forward to our future research.
Keiji Nagatani, Project Manager
He received his master’s degree from Osaka University and Ph.D. (Engineering) from the Graduate School of Engineering Science in 1984. He is a professor at the Department of Mechanical Engineering, Graduate School of Engineering, Osaka University, Director of Creative Design Studio on Technology, and Director of the Komatsu MIRAI Construction Equipment Cooperative Research Center, where he researches on robotics and control engineering.
Professor in Graduate School of Engineering, Osaka University
He received his master’s degree from the Graduate School of Tsukuba University in 1993 and Ph.D. (Engineering) from Bielefeld University in 2010. He is currently engaged in the research and development of field robotics for agriculture, civil engineering and construction, as well as marine applications at Yanmar Holdings.
Group Leader of Robotics Group, System Research Center, R&D Center, Innovation and Technology Division, Yanmar Holdings Co.
Part-time lecturer at Ritsumeikan and Meijo University
He received his Ph.D. from Yokohama National University, the Doctoral Program in 1990. After working for Toshiba Corporation, Micromachine Center, and Okayama University, he was appointed to his current position in 2014. He is the president of s-muscle Co. Ltd., H-MUSCLE Co. Ltd., and the representative of the new academic field “Science of Soft Robots.”
Professor of Tokyo Institute of Technology
He received a master‘s degree from Saitama University Graduate School Pre-Doctoral Course in 1995. He received his Ph.D. (Engineering) from Ritsumeikan University in 2014. After working for Hitachi Zosen Corporation and Bomag Japan Corporation, he is currently a senior researcher at the Public Works Research Institute. He is engaged in research on information-based construction and construction robots.
Senior Researcher, Advanced Technology Research Team, Public Works Research Institute
He received his Ph.D. from the Doctoral Program of Engineering, Kyushu University, in 1999. He researches on the applications of geospatial information and disaster prevention based on rock engineering and geo-environmental engineering.
Professor of Disaster Risk Reduction Research Center, Graduate School of Engineering, Kyusyu University
He received his Ph.D. from Tohoku University in 2008. He was a postdoctoral associate at Massachusetts Institute of Technology and a research associate at Japan Aerospace Exploration Agency (JAXA). His research interests include vehicle–terrain interaction mechanics and autonomous mobility for applications in field robotics.
Associate Professor at Keio University
He received his Ph.D. degree from the Graduate University for Advanced Studies (SOKENDAI) in 2011. Currently, he is engaged in space robotics.
Associate Professor, Graduate School of Engineering, Kyushu Institute of Technology
He received his Ph.D. from the Kyoto University for Doctor of Science in 1994. He has been engaged in onboard equipment development, systems engineering, and project management for space science missions, and is currently promoting research in the framework of the open innovation hub.
Chief engineer (research director of future exploration technology), Space Exploration Innovation Hub Center, Japan Aerospace Exploration Agency (JAXA)
He received his Ph.D. from Wayne State University in 2010. He worked as a research associate at Yonsei University, Ehime University, and is currently a project associate professor at the University of Tokyo. His research interest is in civil engineering, especially in the application of ICT technology to the maintenance and management of bridges and tunnels.
Project Associate Professor, The University of Tokyo
He received his B. Sc., M.Sc., and Ph.D. degrees from the University of Tokyo in 1994, 1996, and 1999, respectively. He is currently a Professor in Computer Vision at Tohoku University, and serves as a leader of the infrastructure management robotics team at RIKEN Center since 2016. His research interests are in the fields of computer vision and machine learning.
Team Leader of RIKEN, Japan
She received her Ph.D. from the University of Tokyo in 2009. She was a postdoctoral fellow at the Los Alamos National Laboratory, University of Tokyo, an associate professor at Yokohama National University. She is currently an associate professor at the University of Tsukuba in 2019. Her research field is structural engineering.
Associate Professor, The University of Tsukuba
He graduated from the Faculty of Engineering, Tokai University, in 1983. He engages in the development and research of construction ICT, automation of construction machinery, and unmanned construction technology at Kumagai Gumi Co., Ltd.
General Manager, ICT Promotion Office, Civil Engineering Division, Kumagai Gumi Co., Ltd.
He received a master’s degree from the Graduate School of Agriculture, Iwate University Master Course in 1985. Currently, he engages in research on the planning and design of volcano robots for natural disaster prevention during volcanic eruptions.
Manager of Business Planning,
Public Consultant Division Kokusai Kogyo Co., Ltd.,
He received his Ph.D. (Engineering) from the University of Tsukuba, Graduate School of Engineering Science in 2002. He is currently engaged in the research and development on intelligent mobile robots, communication technology for robots, disaster response robots, and unmanned construction.
Associate Professor, Mechanical Engineering Program, Kogakuin University
He received M. S. and Dr. Eng. from the University of Tokyo in 1984 and 1989. He became a professor of Research into Artifacts, Center for Engineering (RACE) of the University of Tokyo, a professor at the School of Engineering since 2009, and the director of RACE since 2019. His main research interests are service robotics, distributed autonomous robotic systems, embodied brain science systems, and cognitive ergonomics.
Professor, The University of Tokyo
He received his Ph.D. in Information Science from NAIST in 2007. He is currently a tenure-track associate professor and director of the Robot Learning Lab. His research interests include machine learning and its applications in real-world robots.
Associate Professor, Institute for Research Initiatives, Nara Institute of Science and Technology.
He received his Ph.D. from the Tohoku University Doctoral Program in 1986. His main research field is terramechanics.
Professor of Graduate School of Environmental Studies,
He received his Ph.D. degree from the Department of Mechanical Engineering Science, Tokyo Institute of Technology in 1998. He is a JSME Fellow, SICE Fellow, and RSJ Fellow. His current research interests include legged robot control, computer vision, multiple mobile robots, space robots, service robots, medical imaging, biometrics, and dementia care.
Professor at the Graduate School of Information Science and Electrical Engineering, Kyushu University
He received his Ph.D. from the University of Tsukuba, Japan, in 2007. After working with the Ibaraki Prefectural Industrial Technology Center, the National Institute of Advanced Industrial Science and Technology, University of Tsukuba. His research interests include robot technology for practical applications.
Assistant Professor in the Graduate School of Science and Technology of Hirosaki University.
He received his Ph.D. from the University of Tsukuba in 1997. His current research interests include computer vision and computer graphics.
Professor in the Nara Institute of Science and Technology