The bin lorry driver can monitor the robot's progress using live feeds from cameras on the truck and take manual control of it.
On the other hand, we use appearance-based processes to monitor the robot position along the path and to launch different navigation tasks (e.g. turn left, enter door, etc).
The SwarmFarm system comprises "the Swarm" (multiple robots working together); the SwarmHive (the replenishment station for herbicide, fuel, fertiliser, insecticide or seed); and the SwarmView (the app used to monitor the robots in the field).
The platform is designed so that the hardware, involved in the navigation process, can be monitored during the robot operation and, if desired, their behavior can be altered, allowing the simulation of a failure.
Pilz has developed a multi-camera computer system that monitors the area surrounding robots and adjusts their behaviour accordingly.Called SafetyEYE, the system allows a robot to, say, rivet an aircraft wing without sectioning off the entire area from people.
Next, the monitoring robot obtains the object's 3D coordinates by comparing the RGB image with the depth image.
The monitoring robot receives the information regarding to objects that were selected to ROI and moves to the suitable position for observing.
The object number is allocated from the one closer to the monitoring robot) is calculated by binarization processing using the threshold value (delta).
One way to enforce safety is to endow the robotic system with additional sensors that can to some extent monitor the environment surrounding the robot and allow fast reaction to unexpected obstacles.
In Fig. 11b, the monitoring robot could not stably recognize the spray can at the center of the screen.
