Imaging Systems for Handling and Walking Robots

Application areas for handling robots with our sensors and systems:

1. Industrial manufacturing:

Handling robots with high-speed 3D cameras and spectral imaging can be used in industrial manufacturing to recognize, grip and handle objects precisely. This can be done in various sectors such as the automotive industry, electronics industry or food industry.

2. Logistic and warehousing:

Handling robots can be used in logistics centers and warehouses to identify, sort and stack products. High-speed 3D cameras and spectral imaging can help to identify objects quickly and accurately and optimize handling.

3. Quality control:

Handling robots with high-speed 3D cameras and spectral imaging can be used in quality control to detect defects or irregularities in products. This can be done in the production of electronic components, food or other products.

Our sensor and system solutions for handling robots:

• High-speed 3D measurement systems
• Spectrally resolving sensors
  
• Automated data analysis
• AI based object recognition
  
• Laser scanner and LiDAR
• Ultrasound sensors

Fields of application for our walking robots with our sensors and systems:

1. Exploration of inaccessible areas:

Walking robots can be used in rough terrain to explore hard-to-reach places such as steep slopes, canals or safety zones. The high-speed 3D cameras and spectral imaging can help to detect obstacles and map the surroundings.

2. Inspection of infrastructure:

Walking robots can be used to inspect bridges, buildings or other infrastructure. The high-speed 3D cameras and spectral imaging can help to detect cracks, damage or other structural problems. The autonomous execution of regular inspection tasks can save expensive repairs (Predictive Maintenance).

3. Rescue operations:

In emergency situations, walking robots with high-speed 3D cameras and spectral imaging can be used to search for survivors in rubble or dangerous environments. The robots can recognize obstacles and move them out of the way if necessary. Rescue workers receive important information without putting their own lives in danger.

4. Environmental monitoring:

Walking robots can be used in natural surroundings to monitor the environment. For example, they can be used in areas that are difficult to access to record biodiversity or monitor environmental pollution.

Our sensor and system solutions for walking robots:

• High-speed 3D measurement systems
  
• Photogrammetry 3D systems
  
• Automated data analysis
  
• AI-based object recognition
  
• LiDAR
• 360° camera
• Thermal imaging camera
  
• Special developments on request

We develop compact sensors that can be integrated directly into the robot arm. Various combinations of 3D sensing and multimodal imaging can be realized.

Examples of applications for Handling and Walking robots

In order for handling robots to be able to pick up objects independently, they require sensing that can recognize the objects and determine their position relative to the gripping tool. Bin picking is a special situation in industrial production processes in which objects are removed from a box with disordered contents.

We are developing 3D sensors that make this possible even for objects with surfaces that are difficult to detect optically, e.g., transparent, reflective or jet black. The sensors can be positioned on the robot arm itself or stationary above the objects to be handled.

AI software calculates a suitable trajectory for the movement of the gripping robot and the optimum gripping point without any prior knowledge of the objects. The system can be flexibly integrated into robotics solutions.

Application example – handling of optically uncooperative, transparent objects

We developed a mobile, autonomous disinfection robot for use in hospitals and care facilities. A handling robot was linked to a driverless platform. The entire platform moves autonomously through the facility. A high-resolution 3D sensor, which is attached directly to the robot arm, detects specific objects, and determines their position in the room. This information can be used to carry out disinfection using the UV light source, which is also attached to the robot arm. The disinfection robot can work autonomously in areas with infectious diseases before people enter them.

Application example - high-resolution 3D sensor for the detection of specific objects

Robots and driverless transport systems are already used in many areas of industrial facilities. In inspection processes in particular, sensors are integrated into robot arms in order to automatically scan large and complex shaped workpieces, such as car body parts or castings. Each automated measuring sequence must be planned specifically for each workpiece. This training is complex and time-consuming and is only carried out for a small number of workpieces.

To simplify this process, we developed a robot-guided sensor system that can be controlled interactively using simple gestures. The gestures are recognized by a 3D interaction sensor and automatically translated into commands for the collaborative robot system. The operator can thus issue measurement tasks in real time without any special knowledge. This new type of human-robot interaction allows human skills and sensor technology to complement each other in quality assurance processes.

Control of the mobile sensor platform using pointing gestures

Mobile sensor platform with precise measuring sensor on the robot arm and an interaction sensor for recognizing gestures on the sensor platform

Welding robots typically travel along a predefined path and join metal components together. Automatic path calculation is required if this path is not precisely known in advance, or if training would be too time-consuming. Our 3D sensor, which is mounted directly next to the welding head, enables the detection of edges to be joined. Furthermore, a thermal imaging camera is integrated, which allows direct monitoring and control of the weld seam quality during the welding process.

Recognition of edges to be joined and weld seam control via robot-guided 3D measurement

One advantage of handling robots is their fast working method. However, this can be dangerous for people in the immediate vicinity, meaning that direct cooperation is not possible normally. To make this feasible, we have developed a cell as a protective zone that allows humans and robots to work together safely. Several cameras arranged in this zone record the position of the human's hands and the robot arm in real time. If they come within a critical distance of each other, the robot reduces its speed to a level that is safe for humans.

Sensor-assisted human-machine interaction

Another application in which our sensor is combined with robot platforms is robot-guided deflectometry. Our sensors enable high-precision shape inspection of mirrors during the production process. The desired surface shape is quickly achieved through iterative measurement and processing.

Robotic cell for automatic inspection and processing of free-form mirrors

Downloads for product sheets on our research topics

Our data sheets summarise relevant information on our current research highlights in a compact and clear format. Use the download function to save interesting and relevant topics for later and to save important data and visualisations for later retrieval.

• goSURF^msfr – Flexible Optical Surface Sensor: Measurement of Mid-Spatial-Frequency Roughness of High-Performance Metal Optics
• goSCOUT3D – Portable 3D sensor: Scanning large complex objects by hand
• goDEEP3D – Underwater 3D sensor: Accurate 3D scanning of large complex underwater structures
• goQUALITY3D – 3D sensing of transparent objects: Quality assurance of products with uncooperative surfaces
• goROBOT3D – 3D robot vision of transparent objects: Position and orientation detection of transparent objects for robotic handling
• goSPE3D – High-speed 3D sensor: Shape measurement of (large) dynamic situations
• goCRASH3D – Robust and compact high-speed 3D sensor: Onboard sensor for shape measurement in dynamic situations