High-precision positioning and multi-target detection have been proposed as key technologies for robotic path planning and obstacle avoidance. First, the Cartographer algorithm was used to generate high-quality maps. Then, the iterative nearest point (ICP) and the occupation probability algorithms were combined to scan and match the local point cloud, and the positions and attitudes of the robot were obtained. Furthermore, Sparse Matrix Pose Optimization was carried out to improve the positioning accuracy. The positioning accuracy of the robot in x and y directions was kept within 5 cm, the angle error was controlled within 2°, and the positioning time was reduced by 40%. An improved timing elastic band (TEB) algorithm was proposed to guide the robot to move safely and smoothly. A critical factor was introduced to adjust the distance between the waypoints and the obstacle, generating a safer trajectory, and increasing the constraint of acceleration and end speed; thus, smooth navigation of the robot to the target point was achieved. The experimental results showed that, in the case of multiple obstacles being present, the robot could choose the path with fewer obstacles, and the robot moved smoothly when facing turns and approaching the target point by reducing its overshoot. The proposed mapping, positioning, and improved TEB algorithms were effective for high-precision positioning and efficient multi-target detection.

With the development of intelligent substations, inspection robots are widely used to ensure the safe and stable operation of substations. Due to the prevalence of grass around the substation in the external environment, the inspection robot will be affected by grass when performing the inspection task, which can easily lead to the interruption of the inspection task. At present, inspection robots based on LiDAR sensors regard grass as hard obstacles such as stones, resulting in interruption of inspection tasks and decreased inspection efficiency. Moreover, there are inaccurate multiple object-detection boxes in grass recognition. To address these issues, this paper proposes a new assistance navigation method for substation inspection robots to cross grass areas safely. First, an assistant navigation algorithm is designed to enable the substation inspection robot to recognize grass and to cross the grass obstacles on the route of movement to continue the inspection work. Second, a three-layer convolutional structure of the Faster-RCNN network in the assistant navigation algorithm is improved instead of the original full connection structure for optimizing the object-detection boxes. Finally, compared with several Faster-RCNN networks with different convolutional kernel dimensions, the experimental results show that at the convolutional kernel dimension of 1024, the proposed method in this paper improves the mAP by 4.13% and the mAP is 91.25% at IoU threshold 0.5 in the range of IoU thresholds from 0.5 to 0.9 with respect to the basic network. In addition, the assistant navigation algorithm designed in this paper fuses the ultrasonic radar signals with the object recognition results and then performs the safety judgment to make the inspection robot safely cross the grass area, which improves the inspection efficiency.

The regular detection of weld seams in large-scale special equipment is crucial for improving safety and efficiency, and this can be achieved effectively through the use of weld seam tracking and detection robots. In this study, a wall-climbing robot with integrated seam tracking and detection was designed, and the wall climbing function was realized via a permanent magnet array and a Mecanum wheel. The function of weld seam tracking and detection was realized using a DeepLabv3+ semantic segmentation model. Several optimizations were implemented to enhance the deployment of the DeepLabv3+ semantic segmentation model on embedded devices. Mobilenetv2 was used to replace the feature extraction network of the original model, and the convolutional block attention module attention mechanism was introduced into the encoder module. All traditional 3×3 convolutions were substituted with depthwise separable dilated convolutions. Subsequently, the welding path was fitted using the least squares method based on the segmentation results. The experimental results showed that the volume of the improved model was reduced by 92.9%, only being 21.8 Mb. The average precision reached 98.5%, surpassing the original model by 1.4%. The reasoning speed was accelerated to 21 frames/s, satisfying the real-time requirements of industrial detection. The detection robot successfully realizes the autonomous identification and tracking of weld seams. This study remarkably contributes to the development of automatic and intelligent weld seam detection technologies.

Reflective phenomena often occur in the detecting process of pointer meters by inspection robots in complex environments, which can cause the failure of pointer meter readings. In this paper, an improved k-means clustering method for adaptive detection of pointer meter reflective areas and a robot pose control strategy to remove reflective areas are proposed based on deep learning. It mainly includes three steps: (1) YOLOv5s (You Only Look Once v5-small) deep learning network is used for real-time detection of pointer meters. The detected reflective pointer meters are preprocessed by using a perspective transformation. Then, the detection results and deep learning algorithm are combined with the perspective transformation. (2) Based on YUV (luminance-bandwidth-chrominance) color spatial information of collected pointer meter images, the fitting curve of the brightness component histogram and its peak and valley information is obtained. Then, the k-means algorithm is improved based on this information to adaptively determine its optimal clustering number and its initial clustering center. In addition, the reflection detection of pointer meter images is carried out based on the improved k-means clustering algorithm. (3) The robot pose control strategy, including its moving direction and distance, can be determined to eliminate the reflective areas. Finally, an inspection robot detection platform is built for experimental study on the performance of the proposed detection method. Experimental results show that the proposed method not only has good detection accuracy that achieves 0.809 but also has the shortest detection time, which is only 0.6392 s compared with other methods available in the literature. The main contribution of this paper is to provide a theoretical and technical reference to avoid circumferential reflection for inspection robots. It can adaptively and accurately detect reflective areas of pointer meters and can quickly remove them by controlling the movement of inspection robots. The proposed detection method has the potential application to realize real-time reflection detection and recognition of pointer meters for inspection robots in complex environments.

UNASSIGNED: The flexible joint is a crucial component for the inspection robot to flexible interaction with nuclear power facilities. This paper proposed a neural network aided flexible joint structure optimization method with the Design of Experiment (DOE) method for the nuclear power plant inspection robot.
UNASSIGNED: With this method, the joint\'s dual-spiral flexible coupler was optimized regarding the minimum mean square error of the stiffness. The optimal flexible coupler was demonstrated and tested. The neural network method can be used for the modeling of the parameterized flexible coupler with regard to the geometrical parameters as well as the load on the base of the DOE result.
UNASSIGNED: With the aid of the neural network model of the stiffness, the dual-spiral flexible coupler structure can be fully optimized to a target stiffness, 450 Nm/rad in this case, and a given error level, 0.3% in the current case, with regard to the different loads. The optimal coupler is fabricated with wire electrical discharge machining (EDM) and tested.
UNASSIGNED: The experimental results demonstrate that the load and angular displacement keep a good linear relationship in the given load range and this optimization method can be used as an effective method and tool in the joint design process.

Post-earthquake robots can be used extensively to inspect and evaluate building damage for safety assessment. However, the surrounding environment and path for such robots are complex and unstable with unexpected obstacles. Thus, path planning for such robot is crucial to guarantee satisfactory inspection and evaluation while approaching the ideal position. To achieve this goal, we proposed a distributed small-step path planning method using modified reinforcement learning (MRL). Limited distance and 12 directions were gridly refined for the robot to move around. The small moving step ensures the path planning to be optimal in a neighboring safe region. The MRL updates the direction and adjusts the path to avoid unknown disturbances. After finding the best inspection angle, the camera on the robot can capture the picture clearly, thereby improving the detection capability. Furthermore, the corner point detection method of buildings was improved using the Harris algorithm to enhance the detection accuracy. An experimental simulation platform was established to verify the designed robot, path planning method, and overall detection performance. Based on the proposed evaluation index, the post-earthquake building damage was inspected with high accuracy of up to 98%, i.e., 20% higher than traditional unplanned detection. The proposed robot can be used to explore unknown environments, especially in hazardous conditions unsuitable for humans.

To address power transmission line (PTL) traversing complex environments leading to data collection being difficult and costly, we propose a novel auto-synthesis dataset approach for fitting recognition using prior series data. The approach mainly includes three steps: (1) formulates synthesis rules by the prior series data; (2) renders 2D images based on the synthesis rules utilizing advanced virtual 3D techniques; (3) generates the synthetic dataset with images and annotations obtained by processing images using the OpenCV. The trained model using the synthetic dataset was tested by the real dataset (including images and annotations) with a mean average precision (mAP) of 0.98, verifying the feasibility and effectiveness of the proposed approach. The recognition accuracy by the test is comparable with training by real samples and the cost is greatly reduced to generate synthetic datasets. The proposed approach improves the efficiency of establishing a dataset, providing a training data basis for deep learning (DL) of fitting recognition.

Feet play an important role in the adaptive, versatile, and stable locomotion of legged creatures. Accordingly, several robotic research studies have used biological feet as the inspiration for the design of robot feet in traversing complex terrains. However, so far, no robot feet can allow legged robots to adaptively, versatilely, and robustly crawl on various curved metal pipes, including flat surfaces for pipe inspection. To address this issue, we propose here a novel hybrid rigid-soft robot-foot design inspired by the leg morphology of an inchworm. The foot consists of a rigid section with an electromagnet and a soft toe covering for enhanced adhesion to a metal pipe. Finite element analysis , performed under different loading conditions, reveals that due to its compliance, the soft toe can undergo recoverable deformation with adaptability to various curved metal pipes and plain metal surfaces. We have successfully implemented electromagnetic feet with soft toes (EROFT) on an inchworm-inspired pipe crawling robot for adaptive, versatile, and stable locomotion. Foot-to-surface adaptability is provided by the inherent elasticity of the soft toe, making the robot a versatile and stable metal pipe crawler. Experiments show that the robot crawling success rate reaches 100% on large diameter metal pipes. The proposed hybrid rigid-soft feet (i.e., electromagnetic feet with soft toes) can solve the problem of continuous surface adaptation for the robot in a stable and efficient manner, irrespective of the surface curvature, without the need to manually change the robot feet for specific surfaces. To this end, the foot development enables the robot to meet a set of deployment requirements on large oil and gas pipelines for potential use in inspecting various faults and leakages.

Periodic inspection of false ceilings is mandatory to ensure building and human safety. Generally, false ceiling inspection includes identifying structural defects, degradation in Heating, Ventilation, and Air Conditioning (HVAC) systems, electrical wire damage, and pest infestation. Human-assisted false ceiling inspection is a laborious and risky task. This work presents a false ceiling deterioration detection and mapping framework using a deep-neural-network-based object detection algorithm and the teleoperated \'Falcon\' robot. The object detection algorithm was trained with our custom false ceiling deterioration image dataset composed of four classes: structural defects (spalling, cracks, pitted surfaces, and water damage), degradation in HVAC systems (corrosion, molding, and pipe damage), electrical damage (frayed wires), and infestation (termites and rodents). The efficiency of the trained CNN algorithm and deterioration mapping was evaluated through various experiments and real-time field trials. The experimental results indicate that the deterioration detection and mapping results were accurate in a real false-ceiling environment and achieved an 89.53% detection accuracy.

Routine rodent inspection is essential to curbing rat-borne diseases and infrastructure damages within the built environment. Rodents find false ceilings to be a perfect spot to seek shelter and construct their habitats. However, a manual false ceiling inspection for rodents is laborious and risky. This work presents an AI-enabled IoRT framework for rodent activity monitoring inside a false ceiling using an in-house developed robot called \"Falcon\". The IoRT serves as a bridge between the users and the robots, through which seamless information sharing takes place. The shared images by the robots are inspected through a Faster RCNN ResNet 101 object detection algorithm, which is used to automatically detect the signs of rodent inside a false ceiling. The efficiency of the rodent activity detection algorithm was tested in a real-world false ceiling environment, and detection accuracy was evaluated with the standard performance metrics. The experimental results indicate that the algorithm detects rodent signs and 3D-printed rodents with a good confidence level.