NCBiR
RobREx
scientific project
Autonomy in rescue and exploration robots
Finish: November 2015
Principal Investigator: Włodzimierz Kasprzak, Cezary Zieliński,
Researchers: Konrad Banachowicz, Tomasz Kornuta, Michał Laszkowski, Dawid Seredyński, Maciej Stefańczyk, Wojciech Szynkiewicz, Bartosz Świstak, Michał Walęcki, Tomasz Winiarski,
Task 11
Specification and utilization of manipulation skills to facilitate programming of bimanual manipulation tasks
The proposed method of robot manipulation planning uses a hierarchical approach for the decomposition of manipulation skills. Manipulation skill is a pattern of activity which describes an ability that achieves or maintains a particular goal. Manipulation skills are compositions of basic robot skills to reach some predefined goals. They constitute an interface between low-level constraint-based task specification and high level symbolic task planning. The task of the robot is approximated by a set of parameterized manipulation skills. The parameters are generally related to the task variations, such as: type of a motion, grasping rule, an initial and final configuration. Basic skill is an action that implements a sensory-motor coupling using a single low-level controller.
Grasp synthesis for a multi-fingered robotic hand under object pose uncertainty
In the proposed method of grasp planning, both, object pose uncertainty and object dynamics are considered. These two factors greatly affect success or failure in a real-world robotic grasping and should be considered simultaneously. We use a probabilistic distribution model for the object pose error and incorporate object dynamics along with three metrics into the grasp quality evaluation. The proposed approach is based on simulation of grasping process assuming that the 3D model and dynamics model of the object are known. The key advantage of grasp synthesis using such a simulation is the ability to remove grasps that might seem analytically promising but would fail if executed in reality.
Grasp implementation
Planning of the manipulator trajectory in an unstructured environment is done by taking into account the depth sensor data. Grasp planning is performed by taking into account the expected external forces acting on the grasped object. This methodology was tested on an example of removing the jar cap by two-handed robot.
Experimental systems utilizing position-force and impedance control
For the purpose of manipulation task execution, a task specification and decomposition method was developed and utilized. Manipulation tasks were executed by two different types of robotic systems. The first one was a two arm system composed of two modified industrial manipulators with joint position controllers and additional force/torque sensors mounted in the wrists. Inertial measurement units (IMU) were mounted next to the force/torque sensors. Eye in hand cameras and standalone cameras supplemented the system. The second system was the Velma robot composed of two redundant 7DOF torque controlled arms, active torque controlled torso and position controlled 2DOF head containing a stereo-pair and an RGBD camera. In the case of the first system the virtual effectors controlling the manipulators exhibited four elementary behaviours: idle behaviour, contact with the environment, pure position control, and position control with contact expected. The virtual effectors controlling the manipulators of the second system provided the following behaviours: idle behaviour, extended impedance control on top of the hierarchical torque controller. To improve the quality of force/torque measurements a method taking into account the inertial forces obtained from the IMU readings was developed. Several robot programming frameworks (MRROC++, ROS, OROCOS, Discode) were used to implement and verify the approach.
List of selected publications:
- T. Kornuta, C. Zieliński, and T. Winiarski A universal architectural pattern and specification method for robot control system designBulletin of the Polish Academy of Sciences: Technical Sciences, vol. 68, no. 1, pp. 3–29, 2020[ BIB | DOI | abstract | URL ]
- M. Stefańczyk and R. Pietruch Hypothesis generation in generic, model-based object recognition systemRecent Advances in Automation, Robotics and Measuring Techniques, vol. 440, pp. 717–727, 2016[ BIB | DOI | abstract ]
- M. Stefańczyk, M. Laszkowski, and T. Kornuta WUT Visual Perception Dataset – a dataset for registration and recognition of objectsRecent Advances in Automation, Robotics and Measuring Techniques, vol. 440, pp. 635–645, 2016[ BIB | DOI | abstract | URL ]
- M. Łępicka, T. Kornuta, and M. Stefańczyk Utilization of colour in ICP-based point cloud registrationin Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015, 2016, pp. 821–830[ BIB | DOI | abstract | URL ]
- J. Figat and W. Kasprzak Incremental Version Space Merging Approach to 3D Object Model Acquisition for Robot Visionin Recent Advances in Automation, Robotics and Measuring Techniques, 2016, vol. 440, pp. 561–571[ BIB | DOI | URL ]
- A. Wilkowski and M. Stefańczyk Detection and recognition of compound 3D models by hypothesis generationRecent Advances in Automation, Robotics and Measuring Techniques, vol. 440, pp. 659–668, 2016[ BIB | DOI | abstract ]
- A. Wilkowski, T. Kornuta, M. Stefańczyk, and W. Kasprzak Efficient generation of 3D surfel maps using RGB-D sensorsInternational Journal of Applied Mathematics And Computer Science (AMCS), vol. 26, no. 1, pp. 99–122, 2016[ BIB | DOI | abstract | URL ]
- D. Seredyński and W. Szynkiewicz Fast Grasp Learning for Novel Objectsin Recent Advances in Automation, Robotics and Measuring Techniques, 2016, vol. 440, pp. 681–692[ BIB | DOI | URL ]
- M. Walęcki and C. Zieliński Prediction-Based Visual Servo Controlin Recent Advances in Automation, Robotics and Measuring Techniques, 2016, vol. 440, pp. 693–704[ BIB | DOI | URL ]
- D. Seredyński, T. Winiarski, K. Banachowicz, and C. Zieliński Grasp planning taking into account the external wrenches acting on the grasped objectin 10th International Workshop on Robot Motion and Control (RoMoCo), 2015, pp. 40–45[ BIB | DOI | abstract | URL | VIDEO ]
- A. Wilkowski, T. Kornuta, and W. Kasprzak Point-Based Object Recognition in RGB-D Imagesin Proceedings of the 7th IEEE International Conference Intelligent Systems IS’2014, 2015, vol. 323, pp. 593–604[ BIB | DOI | URL ]
- M. Janiak and C. Zieliński Control System Architecture for the Investigation of Motion Control Algorithms on an Example of the Mobile Platform RexBulletin of the Polish Academy of Sciences – Technical Sciences, vol. 63, no. 3, pp. 667–678, 2015[ BIB | DOI | URL ]
- W. Szynkiewicz Robot grasp synthesis under object pose uncertaintyJournal of Automation Mobile Robotics and Intelligent Systems, vol. 9, no. 1, pp. 53–61, 2015[ BIB | DOI ]
- W. Kasprzak, R. Pietruch, K. B. A. Wilkowski, and T. Kornuta Integrating Data- and Model-Driven Analysis of RGB-D Imagesin Proceedings of the 7th IEEE International Conference Intelligent Systems IS’2014, 2015, vol. 323, pp. 605–616[ BIB | DOI | URL ]
- C. Zieliński and T. Kornuta An Object-Based Robot Ontologyin Proceedings of the 7th IEEE International Conference Intelligent Systems IS’2014, 2015, vol. 323, no. 3-14[ BIB | DOI | URL ]
- W. Szynkiewicz Synteza chwytu przy niepewności pozycji obiektuin Postępy robotyki, vol. 1,Oficyna Wydawnicza PW, 2014, pp. 25–34 [ BIB | URL ]
- C. Zieliński and T. Kornuta Ontologia na potrzeby sterowania robotem usługowymin XIII Krajowa Konferencja Robotyki – Postępy robotyki, 2014, vol. 194, no. 1, pp. 493–502[ BIB | URL ]
- T. Kornuta, M. Stefańczyk, and W. Kasprzak Basic 3D solid recognition in RGB-D imagesin Recent Advances in Automation, Robotics and Measuring Techniques, 2014, vol. 267, pp. 421–430[ BIB | DOI | abstract | URL ]
- W. Kasprzak, T. Kornuta, and C. Zieliński A virtual receptor in a robot control frameworkin Recent Advances in Automation, Robotics and Measuring Techniques, 2014, vol. 267, pp. 399–408[ BIB | URL ]
- M. Janiak and C. Zieliński Platforma mobilna Rex – struktura układu sterowaniain XIII Krajowa Konferencja Robotyki – Postępy robotyki, 2014, vol. 194, no. 1, pp. 45–54[ BIB | URL ]
- M. Walęcki, K. Banachowicz, M. Stefańczyk, T. Winiarski, R. Chojecki, and C. Zieliński Korpus robota usługowego Velmain XIII Krajowa Konferencja Robotyki – Postępy robotyki, 2014, vol. 1, pp. 5–14[ BIB | abstract | URL ]
- D. Seredyński, T. Winiarski, K. Banachowicz, and C. Zieliński Sterownik chwytaka trójpalczastegoin XIII Krajowa Konferencja Robotyki – Postępy robotyki, 2014, vol. 1, pp. 15–24[ BIB | abstract | URL ]
- C. Zieliński and T. Kornuta Specification of Tasks in Terms of Object-level Relations for a Two-handed Robotin Recent Advances in Automation, Robotics and Measuring Techniques, 2014, vol. 267, pp. 543–552[ BIB | URL ]
- T. Kornuta Młodzi Innowacyjni 2014. Innowacyjne rozwiązania w obszarze automatyki, robotyki i pomiarówJ. Kacprzyk, Ed. Przemysłowy Instytut Automatyki i Pomiarów PIAP, 2014, pp. 114–137 [ BIB ]
- T. Kornuta, C. Zieliński, and T. Winiarski Ontologia robotów manipulacyjnych cz. II: środowiskoin Aktualne Problemy Automatyki i Robotyki, 2014, vol. 20, pp. 332–341[ BIB | abstract | URL ]
- T. Kornuta, T. Winiarski, and C. Zieliński Ontologia robotów manipulacyjnych cz. I: robotin Aktualne Problemy Automatyki i Robotyki, 2014, vol. 20, pp. 320–331[ BIB | abstract | URL ]
- C. Zieliński, T. Kornuta, and T. Winiarski A Systematic Method of Designing Control Systems for Service and Field Robotsin 19-th IEEE International Conference on Methods and Models in Automation and Robotics, MMAR’2014, 2014, pp. 1–14[ BIB | DOI | abstract | URL ]
- M. Stefańczyk, K. Banachowicz, M. Walęcki, and T. Winiarski 3D camera and lidar utilization for mobile robot navigationJournal of Automation Mobile Robotics and Intelligent Systems, vol. 7, no. 4, pp. 27–33, 2013[ BIB | DOI | abstract ]
- M. Stefańczyk, K. Bojar, and W. Kasprzak Utilization of Depth and Color Information in Mobile Roboticsin Proceedings of the 8th International Conference on Computer Recognition Systems CORES 2013, 2013, vol. 226, pp. 845–854[ BIB | DOI | abstract | URL ]
- P. Trojanek, T. Kornuta, and C. Zieliński Design of asynchronously stimulated robot behavioursin Robot Motion and Control (RoMoCo), 9th Workshop on, 2013, pp. 129–134[ BIB | DOI | URL ]
- T. Winiarski, K. Banachowicz, and M. Stefańczyk Safe strategy of door opening with impedance controlled manipulatorJournal of Automation Mobile Robotics and Intelligent Systems, vol. 7, no. 4, pp. 21–26, 2013[ BIB | DOI | abstract | URL ]
- T. Winiarski and K. Banachowicz System akwizycji skorygowanej siły uogólnionej kontaktu robota manipulacyjnego z otoczeniemPomiary Automatyka Robotyka, no. 2, pp. 390–394, 2013[ BIB | abstract | URL ]
- M. Walęcki, M. Stefańczyk, and T. Kornuta Control system of the active head of a service robot exemplified on visual servoingin Robot Motion and Control (RoMoCo), 9th Workshop on, 2013, pp. 48–53[ BIB | DOI | abstract | URL ]
- W. Szynkiewicz Skill-Based Bimanual Manipulation PlanningJournal of Telecommunications and Information Technology, no. 4, pp. 54–62, 2012[ BIB | URL ]