Posts by Collection

portfolio

🤝 Delegation of the Wuxi Industrial Innovation Research Institute visited of the ISR Lab

The delegation of the Wuxi Industrial Innovation Research Institute visited of the Intelligent Space Robotics Lab. (Skoltech Center for Digital Engineering) as part of a visit to Skoltech. The Head of the laboratory, Associate Professor Dzmitry Tsetserukou and a students of the Master’s programs Engineering Systems and Advance Computational Science Ziang Guo, Koffivi Fidèle Gbagbe told about its researches and development, in particular, about research on UAVs, haptics (robot petrol station), large language models and self-driving cars. Arrangements for co-operation reached. 📸 Timur Sabirov

presentation

publications

Paper Title Number 4

Published in GitHub Journal of Bugs, 2024

This paper is about fixing template issue #693.

Recommended citation: Your Name, You. (2024). "Paper Title Number 3." GitHub Journal of Bugs. 1(3).
Download Paper

Bi-VLA:Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulations

Published in IEEE Int. Conf. Systems, Man, and Cybernetics (SMC 2024), Sarawak, Malaysia, 6-10 Oct., 2024, 2024

This research introduces the Bi-VLA (Vision-Language-Action) model, a novel system designed for bimanual robotic dexterous manipulation that seamlessly integrates vision for scene understanding, language comprehension for translating human instructions into executable code, and physical action generation. We evaluated the system’s functionality through a series of household tasks, including the preparation of a desired salad upon human request. Bi-VLA demonstrates the ability to interpret complex human instructions, perceive and understand the visual context of ingredients, and execute precise bimanual actions to prepare the requested salad. We assessed the system’s performance in terms of accuracy, efficiency, and adaptability to different salad recipes and human preferences through a series of experiments. Our results show a 100% success rate in generating the correct executable code by the Language Module, a 96.06% success rate in detecting specific ingredients by the Vision Module, and an overall success rate of 83.4% in correctly executing user-requested tasks.

Recommended citation: @misc{gbagbe2024bivlavisionlanguageactionmodelbasedbimanual, title={Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulations}, author={Koffivi Fidèle Gbagbe and Miguel Altamirano Cabrera and Ali Alabbas and Oussama Alyunes and Artem Lykov and Dzmitry Tsetserukou}, year={2024}, eprint={2405.06039}, archivePrefix={arXiv}, primaryClass={cs.RO}, url={https://arxiv.org/abs/2405.06039}, }
Download Paper | Download Slides

Published in , 1900

talks

teaching

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.