Download or read book Image based Visual Servoing Using Improved Image Moments in 6 DOF Robot Systems written by Sining Liu and published by . This book was released on 2008 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Visual servoing has played an important role in automated robotic manufacturing systems. This thesis will focus on this issue and proposes an improved method which includes an ameliorative image pre-processing (IP) algorithm and an amendatory IBVS algorithm As the first contribution, an improved IP algorithm based on the morphological theory has been discussed for the purpose of removing the unexpected speckles and balancing the illumination during the image processing. After this enhancing process, the useful information in the image becomes prominent and can be utilized to extract the accurate image features. Then, an improved IBVS algorithm is therefore further introduced for an eye-in-hand system as the second contribution. This eye-in-hand system includes a 6 Degree of Freedom (DOF) robot and a camera. The improved IBVS algorithm utilizes the image moment as the image features instead of detecting the special points for feature extraction in traditional IBVS. Comparing with traditional IBVS, choosing image moment as the image features can increase the stability of the system and extend the applied range of objects. The obtained image features will then be used to generate the control signals for the robot to track the target object. The Jacobian matrix describing the relationship between the motion of camera and velocity of image features is also discussed, where a new simple method has been proposed for the estimation of depth involved in the Jacobian matrix. In order to decouple the obtained Jacobian matrix for controlling the motion of camera with individual image features, a four stages sequence control has also been introduced to improve the control performance.

Download or read book Visual Servoing in Robotics written by Jorge Pomares and published by MDPI. This book was released on 2021-08-31 with total page 166 pages. Available in PDF, EPUB and Kindle. Book excerpt: Visual servoing is a well-known approach to guide robots using visual information. Image processing, robotics, and control theory are combined in order to control the motion of a robot depending on the visual information extracted from the images captured by one or several cameras. With respect to vision issues, a number of issues are currently being addressed by ongoing research, such as the use of different types of image features (or different types of cameras such as RGBD cameras), image processing at high velocity, and convergence properties. As shown in this book, the use of new control schemes allows the system to behave more robustly, efficiently, or compliantly, with fewer delays. Related issues such as optimal and robust approaches, direct control, path tracking, or sensor fusion are also addressed. Additionally, we can currently find visual servoing systems being applied in a number of different domains. This book considers various aspects of visual servoing systems, such as the design of new strategies for their application to parallel robots, mobile manipulators, teleoperation, and the application of this type of control system in new areas.

Download or read book Enhanced Image Based Visual Servoing Dealing with Uncertainties written by Ahmad Ghasemi and published by . This book was released on 2020 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Nowadays, the applications of robots in industrial automation have been considerably increased. There is increasing demand for the dexterous and intelligent robots that can work in unstructured environment. Visual servoing has been developed to meet this need by integration of vision sensors into robotic systems. Although there has been significant development in visual servoing, there still exist some challenges in making it fully functional in the industry environment. The nonlinear nature of visual servoing and also system uncertainties are part of the problems affecting the control performance of visual servoing. The projection of 3D image to 2D image which occurs in the camera creates a source of uncertainty in the system. Another source of uncertainty lies in the camera and robot manipulator's parameters. Moreover, limited field of view (FOV) of the camera is another issues influencing the control performance. There are two main types of visual servoing: position-based and image-based. This project aims to develop a series of new methods of image-based visual servoing (IBVS) which can address the nonlinearity and uncertainty issues and improve the visual servoing performance of industrial robots. The first method is an adaptive switch IBVS controller for industrial robots in which the adaptive law deals with the uncertainties of the monocular camera in eye-in-hand configuration. The proposed switch control algorithm decouples the rotational and translational camera motions and decomposes the IBVS control into three separate stages with different gains. This method can increase the system response speed and improve the tracking performance of IBVS while dealing with camera uncertainties. The second method is an image feature reconstruction algorithm based on the Kalman filter which is proposed to handle the situation where the image features go outside the camera's FOV. The combination of the switch controller and the feature reconstruction algorithm can not only improve the system response speed and tracking performance of IBVS, but also can ensure the success of servoing in the case of the feature loss. Next, in order to deal with the external disturbance and uncertainties due to the depth of the features, the third new control method is designed to combine proportional derivative (PD) control with sliding mode control (SMC) on a 6-DOF manipulator. The properly tuned PD controller can ensure the fast tracking performance and SMC can deal with the external disturbance and depth uncertainties. In the last stage of the thesis, the fourth new semi off-line trajectory planning method is developed to perform IBVS tasks for a 6-DOF robotic manipulator system. In this method, the camera's velocity screw is parametrized using time-based profiles. The parameters of the velocity profile are then determined such that the velocity profile takes the robot to its desired position. This is done by minimizing the error between the initial and desired features. The algorithm for planning the orientation of the robot is decoupled from the position planning of the robot. This allows a convex optimization problem which lead to a faster and more efficient algorithm. The merit of the proposed method is that it respects all of the system constraints. This method also considers the limitation caused by camera's FOV. All the developed algorithms in the thesis are validated via tests on a 6-DOF Denso robot in an eye-in-hand configuration.

Download or read book Visual Servoing For Robotic Positioning And Tracking Systems written by Yimin Zhao and published by . This book was released on 2012 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Real Time Stereo Visual Servoing of a 6 DOF Robot for Tracking and Grasping Moving Objects written by Abolfazl Mohebbi and published by . This book was released on 2013 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Computational Intelligence Methods for Green Technology and Sustainable Development written by Yo-Ping Huang and published by Springer Nature. This book was released on 2022-12-14 with total page 685 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides readers with peer-reviewed research papers presented at the 6th International Conference on Green Technology and Sustainable Development (GTSD) held in Nha Trang City, Vietnam, from July 29 to 30, 2022. The book is original work of researchers from academia and industry focusing on the theme “Green technology and sustainable development in Industrial Revolution 4.0” not only to raise awareness of the vital importance of sustainability in education, technology, and economic development, but also to highlight the essential roles of technology innovation for the green future. The book presents a wide range of research aspects including energy engineering, electric power systems, renewable energy systems, automatic control engineering, robotics, vehicle engineering, material engineering, construction engineering, mechanical engineering, vibrations, computational analysis, numerical investigation, system failure, technological solutions in health care, and so on. Through thorough research basing on both experimental and numerical methods, the authors feature either solutions for existing problems or optimization and improvement for performance of existing methods. The collected research results could be useful alternatives and implications for industry experts, research institutions, universities, and all others who share a common interest in the future global sustainable development.

Download or read book Visual Servoing written by Koichi Hashimoto and published by World Scientific. This book was released on 1993 with total page 378 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book treats visual feedback control of mechanical systems, mostly robot manipulators. It not only deals with image processing techniques and robot control schemes but also covers the latest investigation of the design of the visual servo mechanism based on modern linear and nonlinear control theory, the adaptive control scheme, fuzzy logic, and neural networks. New concepts for utilizing visual sensory information for real-time manipulator control are derived and the performances are evaluated through simulations and/or experiments.The contributors to this book are robotics specialists from all over the world. The book gives a practical perspective on visual servoing to researchers, engineers, and students working in this area.

Download or read book Image Based Visual Servoing Using Trajectory Planning and Augmented Visual Servoing Controller written by Mohammad Keshmiri and published by . This book was released on 2015 with total page 178 pages. Available in PDF, EPUB and Kindle. Book excerpt: Robots and automation manufacturing machineries have become an inseparable part of industry, nowadays. However, robotic systems are generally limited to operate in highly structured environments. Although, sensors such as laser tracker, indoor GPS, 3D metrology and tracking systems are used for positioning and tracking in manufacturing and assembly tasks, these devices are highly limited to the working environment and the speed of operation and they are generally very expensive. Thus, integration of vision sensors with robotic systems and generally visual servoing system allows the robots to work in unstructured spaces, by producing non-contact measurements of the working area. However, projecting a 3D space into a 2D space, which happens in the camera, causes the loss of one dimension data. This initiates the challenges in vision based control. Moreover, the nonlinearities and complex structure of a manipulator robot make the problem more challenging. This project aims to develop new reliable visual servoing methods that allow its use in real robotic tasks. The main contributions of this project are in two parts; the visual servoing controller and trajectory planning algorithm. In the first part of the project, a new image based visual servoing controller called Augmented Image Based Visual Servoing (AIBVS) is presented. A proportional derivative (PD) controller is developed to generate acceleration as the controlling command of the robot. The stability analysis of the controller is conducted using Lyapanov theory. The developed controller has been tested on a 6 DOF Denso robot. The experimental results on point features and image moment features demonstrate the performance of the proposed AIBVS. Experimental results show that a damped response could be achieved using a PD controller with acceleration output. Moreover, smoother feature and robot trajectories are observed compared to those in conventional IBVS controllers. Later on, this controller is used on a moving object catching process. Visual servoing controllers have shown difficulty in stabilizing the system in global space. Hence, in the second part of the project, a trajectory planning algorithm is developed to achieve the global stability of the system. The trajectory planning is carried out by parameterizing the camera's velocity screw. The camera's velocity screw is parameterized using time-based profiles. The parameters of the velocity profile are then determined such that the velocity profile guides the robot to its desired position. This is done by minimizing the error between the initial and desired features. This method provides a reliable path for the robot considering all robotic constraints. The developed algorithm is tested on a Denso robot. The results show that the trajectory planning algorithm is able to perform visual servoing tasks which are unstable when performed using visual servoing controllers.

Download or read book Image Based Visual Servoing for Robotic Systems written by Warren Dixon and published by . This book was released on 2004 with total page 5 pages. Available in PDF, EPUB and Kindle. Book excerpt: There is significant motivation to provide robotic systems with improved autonomy as a means to significantly accelerate deactivation and decommissioning (D & D) operations while also reducing the associated costs, removing human operators from hazardous environments, and reducing the required burden and skill of human operators. To achieve improved autonomy, this project focused on the basic science challenges leading to the development of visual servo controllers. The challenge in developing these controllers is that a camera provides 2-dimensional image information about the 3-dimensional Euclidean-space through a perspective (range dependent) projection that can be corrupted by uncertainty in the camera calibration matrix and by disturbances such as nonlinear radial distortion. Disturbances in this relationship (i.e., corruption in the sensor information) propagate erroneous information to the feedback controller of the robot, leading to potentially unpredictable task execution. This research project focused on the development of a visual servo control methodology that targets compensating for disturbances in the camera model (i.e., camera calibration and the recovery of range information) as a means to achieve predictable response by the robotic system operating in unstructured environments. The fundamental idea is to use nonlinear Lyapunov-based techniques along with photogrammetry methods to overcome the complex control issues and alleviate many of the restrictive assumptions that impact current robotic applications. The outcome of this control methodology is a plug-and-play visual servoing control module that can be utilized in conjunction with current technology such as feature recognition and extraction to enable robotic systems with the capabilities of increased accuracy, autonomy, and robustness, with a larger field of view (and hence a larger workspace). The developed methodology has been reported in numerous peer-reviewed publications and the performance and enabling capabilities of the resulting visual servo control modules have been demonstrated on mobile robot and robot manipulator platforms.

Download or read book Utilisation of Photometric Moments in Visual Servoing written by Manikandan Bakthavatchalam and published by . This book was released on 2015 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: This thesis is concerned with visual servoing, a feedback control technique for controlling camera-equipped actuated systems like robots. For visual servoing, it is essential to synthesize visual information from the camera image in the form of visual features and establish the relationship between their variations and the spatial motion of the camera. The earliest visual features are dependent on the extraction and visual tracking of geometric primitives like points and straight lines in the image. It was shown that visual tracking and image processing procedures are a bottleneck to the expansion of visual servoing methods. That is why the image intensity distribution has also been used directly as a visual feature. Finally, visual features based on image moments allowed to design decoupled control laws but they are restricted by the availability of a well-segmented regions or a discrete set of points in the scene. This work proposes the strategy of capturing the image intensities not directly, but in the form of moments computed on the whole image plane. These global features have been termed photometric moments. Theoretical developments are made to derive the analytical model for the interaction matrix of the photometric moments. Photometric moments enable to perform visual servoing on complex scenes without visual tracking or image matching procedures, as long as there is no severe violation of the zero border assumption (ZBA). A practical issue encountered in such dense VS methods is the appearance and disappearance of portions of the scene during the visual servoing. Such unmodelled effects strongly violate the ZBA assumption and can disturb the control and in the worst case, result in complete failure to convergence. To handle this important practical problem, an improved modelling scheme for the moments that allows for inclusion of spatial weights is proposed. Then, spatial weighting functions with a specific structure are exploited such that an analytical model for the interaction matrix can be obtained as simple functions of the newly formulated moments. A part of this work provides an additional contribution towards the problem of simultaneous control of rotational motions around the image axes. The approach is based on connecting the design of the visual feature such that the visual servoing is optimal with respect to specific criteria. Few selection criteria based on the interaction matrix was proposed. This contribution opens interesting possibilities and finds immediate applications in the selection of visual features in image moments-based VS.

Download or read book Image Based Visual Servoing for Robotic Systems written by and published by . This book was released on 2002 with total page 5 pages. Available in PDF, EPUB and Kindle. Book excerpt: The objective of this project is to enable current and future EM robots with an increased ability to perceive and interact with unstructured and unknown environments through the use of camera-based visual servo controlled robots. The scientific goals of this research are to develop a new visual servo control methodology that: (1) adapts for the unknown camera calibration parameters (e.g., focal length, scaling factors, camera position and orientation) and the physical parameters of the robotic system (e.g., mass, inertia, friction), (2) compensates for unknown depth information (extract 3D information from the 2D image), and (3) enables multi-uncalibrated cameras to be used as a means to provide a larger field-of-view. Nonlinear Lyapunov-based techniques are being used to overcome the complex control issues and alleviate many of the restrictive assumptions that impact current visual servo controlled robotic systems. The potential relevance of this control methodology will be a plug-and-play visual servoing control module that can be utilized in conjunction with current technology such as feature extraction and recognition, to enable current EM robotic systems with the capabilities of increased accuracy, autonomy, and robustness, with a larger field of view (and hence a larger workspace). These capabilities will enable EM robots to significantly accelerate D & D operations by providing for improved robot autonomy and increased worker productivity, while also reducing the associated costs, removing the human operator from the hazardous environments, and reducing the burden and skill of the human operators.

Download or read book Visual Servoing via Advanced Numerical Methods written by Graziano Chesi and published by Springer. This book was released on 2010-03-10 with total page 410 pages. Available in PDF, EPUB and Kindle. Book excerpt: Robots able to imitate human beings have been at the core of stories of science?ctionaswellasdreamsofinventorsforalongtime.Amongthe various skills that Mother Nature has provided us with and that often go forgotten, the ability of sight is certainly one of the most important. Perhaps inspired by tales of Isaac Asimov, comics and cartoons, and surely helped by the progress of electronics in recent decades, researchers have progressively made the dream of creating robots able to move and operate by exploiting arti?cial vision a concrete reality. Technically speaking, we would say that these robots position themselves and their end-e?ectors by using the view provided by some arti?cial eyes as feedback information. Indeed, the arti?cial eyes are visual sensors such as cameras that have the function to acquire an image of the environment. Such an image describes if and how the robot is moving toward the goal and hence constitutes feedback information. This procedure is known in robotics with the term visual servoing, and it is nothing else than an imitation of the intrinsic mechanism that allows human beings to realize daily tasks such as reaching the door of the house or grasping a cup of co?ee.

Download or read book Visual Perception and Robotic Manipulation written by Geoffrey Taylor and published by Springer. This book was released on 2008-08-18 with total page 231 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book moves toward the realization of domestic robots by presenting an integrated view of computer vision and robotics, covering fundamental topics including optimal sensor design, visual servo-ing, 3D object modelling and recognition, and multi-cue tracking, emphasizing robustness throughout. Covering theory and implementation, experimental results and comprehensive multimedia support including video clips, VRML data, C++ code and lecture slides, this book is a practical reference for roboticists and a valuable teaching resource.

Download or read book Image based Visual Servoing with Hybrid Camera Configuration for Robust Robotic Grasping written by and published by . This book was released on 2003 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: A challenging anthropomorphic characteristic which a robotic manipulator should acquire is vision. When first introduced to manufacturing and material-handling industries, robots were taught to move "blindly" in a structured environment where the position and the orientation of the manipulated object were assumed to be known. Since then, a spectrum of visual servoing techniques has been developed to increase the versatility and accuracy of the robotic manipulators for carrying out tasks in less structured environments. In particular, the concept of continuous motion control of robotic systems using a visual feedback loop has been applied recently to unstructured environments. In the work presented in this thesis, a functioning mobile manipulator platform, named Autonomous Intelligent Mobile Manipulator (AIMM) with a hybrid camera configuration has been developed. This platform is a member of the cooperative heterogeneous mobile robotic team at the Industrial Automation Laboratory (IAL) of the University of British Columbia (UBC). Given the increasing threat of terrorism and natural disasters around the world, the encompassing research explores new robotic solutions for search and rescue applications. Specifically, the LkL robotics subgroup develops robotic capabilities that can assist or even replace human rescuers in situations that involve life threatening risks. The main contribution of the work in this thesis can be summarized by its two aspects: hardware and control scheme. The developed mobile manipulator consists of a light-weight yet capable manipulator, a mobile robotic base, and a hybrid camera configuration using both a monocular camera and a stereo camera. The classical image-based visual servoing scheme has been improved by techniques of depth estimation and neural network-based grasping. In the present work, both the platform and the control scheme have been tested in real-life scenarios where multiple robots complete a complex task of object handling.

Download or read book Image Based and Fractional Order Control for Mechatronic Systems written by Cosmin Copot and published by Springer Nature. This book was released on 2020-04-10 with total page 211 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book unites two fast-developing forms of control—vision-based control and fractional-order control—and applies them in mechatronic systems. Image-Based and Fractional-Order Control for Mechatronic Systems is presented in two parts covering the theory and applications of the subject matter. The theoretical material presents the concepts of visual servoing and image-based feature extraction for feedback loops and fractional-order control. It discusses a range of systems from the classic monocular camera to new RGB-D sensors. The applications part of the book first discusses practical issues with the implementation of fractional-order control, comparing them with more traditional integer-order PID systems. The authors then introduce real-life examples such as a manipulator robot and a Stewart platform and results generated from such systems. MATLAB® functions and source codes are included wherever relevant to help readers develop simulations based on the theoretical ideas and practical examples in the text. Suggestions for the use of other pertinent open-source software are also indicated with the places where such may be obtained. With its combination of theoretical ideas and practical examples, Image-Based and Fractional-Order Control for Mechatronic Systems will be of interest to academic researchers looking to develop the fields of vision-based and fractional-order control and to engineers who are looking for developments that will help them provide closer control of their plants than can be achieved with integer-order PID. Advances in Industrial Control reports and encourages the transfer of technology in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. The series offers an opportunity for researchers to present an extended exposition of new work in all aspects of industrial control.

Download or read book Comparison of Image based and Position based Robot Visual Servoing Methods and Improvements microform written by Lingfeng Deng and published by National Library of Canada = Bibliothèque nationale du Canada. This book was released on 2003 with total page 636 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Visual Servoing in Robotic Manufacturing Systems for Accurate Positioning written by Zheng Li and published by . This book was released on 2007 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: