Published on Apr 02, 2024
The field of Humanoids Robotics is widely recognized as the current challenge for robotics research .The humanoid research is an approach to understand and realize the complex real world interactions between a robot, an environment, and a human.
The humanoid robotics motivates social interactions such as gesture communication or co-operative tasks in the same context as the physical dynamics. This is essential for three-term interaction, which aims at fusing physical and social interaction at fundamental levels.
People naturally express themselves through facial gestures and expressions. Our goal is to build a facial gesture human-computer interface fro use in robot applications. This system does not require special illumination or facial make-up. By using multiple Kalman filters we accurately predict and robustly track facial features. Since we reliably track the face in real-time we are also able to recognize motion gestures of the face. Our system can recognize a large set of gestures (13) ranging from "yes", "no" and "may be" to detecting winks, blinks and sleeping.
In order to validate the anthropomorphic model of sensory-motor co-ordination in grasping, a module was implemented to perform visual and tactile edge tracking, considered as the first step of sensory-motor co-ordination in grasping actions.
The proposed methodology includes the application of the reinforcement-learning paradigm to back propagation NNs, in order to replicate the human capability of creating associations between sensory data and motor schemes, based on the results of attempts to perform movements. The resulting robot behavior consists in co-ordinating the movement of the fingertip along an object edge, by integrating visual information on the edge, proprioceptive information on the arm configuration, and tactile information on the contact, and by processing this information in a neural framework based on the reinforcement-learning paradigm. The aimed goal of edge tracking is pursued by a strategy starting from a totally random policy and evolving via rewards and punishments
The use of MEP tracking system is made to implement the facial gesture interface. This vision system is manufactured by Fujitsu and is designed to track in real time multiple templates in frames of a NTSC video stream. It consists of two VME-bus cards, a video module and tracking module, which can track up to 100 templates simultaneously at video frame rate (30Hz for NTSC).
The tracking of objects is based on template (8x8 or 16x16 pixels) comparison in a specified search area. The video module digitizes the video input stream and stores the digital images into dedicated video RAM. The tracking module also accesses this RAM. The tracking module compares the digitized frame with the tracking templates within the bounds of the search windows.
This comparison is done by using a cross correlation which sums the absolute difference between corresponding pixels of the template and the frame. The result of this calculation is called the distortion and measures the similarity of the two comparison images. Low distortions indicate a good match while high distortions result when the two images are quite different.
A general framework for artificial perception and sensory-motor co-ordination in robotic grasping has been proposed at the ARTS LAB, based on the integration of visual and tactile perception, processed through anthropomorphic schemes for control, behavioral planning and learning. The problem of grasping has been sub-divided into four key problems, for which specific solutions have been implemented and validated through experimental trials, relying on anthropomorphic sensors and actuators, such as an integrated fingertip (including a tactile, a thermal and a dynamic sensor), a retina-like visual sensor, and the anthropomorphic Dexter arm and Marcus hand
Figure 3: The Marcus Hand with the integrated fingertip And the Dexter Arm
In particular,
1. Planning of the pre-grasping hand shaping,
2. Learning of motor co-ordination strategies.
3. Tactile-motor co-ordination in graspind and
4. Object classification based on the visuo-tactile information are described and reported in the following paragraphs
The humanoid research is an approach to understand and realize flexible complex interactions between robots, environment and humans. A humanoid robot is an ideal tool for the robotics research; First of all it introduces complex interactions due to its complex structure. It can be involved in various physical dynamics by just changing its posture without need for a different experimental platform. This promotes a unified approach to handling different dynamics. Since it resembles humans, we can start by applying our intuitive strategy and investigate why it works or not.
Moreover, it motivates social interactions such as gestural communication or cooperative tasks in the same context as the physical dynamics. This is essential for three-term interaction, which aims at fusing physical and social interaction at fundamental levels. Integrating human body components such as human prostheses for upper limbs, and anthropomorphic control and behavioral schemes can approach the humanoid robotics. The Gesture Recognizer module that runs in parallel with the face-tracking module is capable of recognizing a wide variety of gestures based on head movements. Gesture recognition is robust due to the statistical approach we have adopted. In future the plan is to record and analyze the head gestures of a large sample of people. The plan is also to explore the prospect of allowing the machines to learn gestures based on observation.
| Are you interested in this topic.Then mail to us immediately to get the full report.
email :- contactv2@gmail.com |
