Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts
Giannikos J-M, Leins D, Moringen A, Kroemer O (2023)
In: Workshop on Touch Processing: a new Sensing Modality for AI. Workshop on Touch Processing: a new Sensing Modality for AI. .
Kurzbeitrag Konferenz / Poster | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Einrichtung
Abstract / Bemerkung
We design and train a composition of neural network modules that predicts robotic
grasp success based on tactile sensor measurements and natural language prompts
identifying the object. We use a Franka Emika Panda robot arm equipped with
two DIGIT sensors for grasping and language descriptions generated by chatGPT.
Our short-term goal is to utilize this approach to improve the accuracy of a grasp
stability estimator. The longer-term goal of this work is to enhance haptically
driven robot control with language-based context, i.e. task-relevant information
which might not be robustly inferred from vision.
Erscheinungsjahr
2023
Titel des Konferenzbandes
Workshop on Touch Processing: a new Sensing Modality for AI
Serien- oder Zeitschriftentitel
Workshop on Touch Processing: a new Sensing Modality for AI
Konferenz
Conference on Neural Information Processing Systems
Konferenzort
New Orleans
Konferenzdatum
2023-12-10 – 2023-12-16
Page URI
https://pub.uni-bielefeld.de/record/2993846
Zitieren
Giannikos J-M, Leins D, Moringen A, Kroemer O. Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts . In: Workshop on Touch Processing: a new Sensing Modality for AI. Workshop on Touch Processing: a new Sensing Modality for AI. 2023.
Giannikos, J. - M., Leins, D., Moringen, A., & Kroemer, O. (2023). Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts . Workshop on Touch Processing: a new Sensing Modality for AI, Workshop on Touch Processing: a new Sensing Modality for AI
Giannikos, Jan-Malte, Leins, David, Moringen, Alexandra, and Kroemer, Oliver. 2023. “Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts ”. In Workshop on Touch Processing: a new Sensing Modality for AI. Workshop on Touch Processing: a new Sensing Modality for AI.
Giannikos, J. - M., Leins, D., Moringen, A., and Kroemer, O. (2023). “Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts ” in Workshop on Touch Processing: a new Sensing Modality for AI Workshop on Touch Processing: a new Sensing Modality for AI.
Giannikos, J.-M., et al., 2023. Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts . In Workshop on Touch Processing: a new Sensing Modality for AI. Workshop on Touch Processing: a new Sensing Modality for AI.
J.-M. Giannikos, et al., “Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts ”, Workshop on Touch Processing: a new Sensing Modality for AI, Workshop on Touch Processing: a new Sensing Modality for AI, 2023.
Giannikos, J.-M., Leins, D., Moringen, A., Kroemer, O.: Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts . Workshop on Touch Processing: a new Sensing Modality for AI. Workshop on Touch Processing: a new Sensing Modality for AI. (2023).
Giannikos, Jan-Malte, Leins, David, Moringen, Alexandra, and Kroemer, Oliver. “Blind Robotic Grasp Stability Estimation Based on Tactile Measurements and Natural Language Prompts ”. Workshop on Touch Processing: a new Sensing Modality for AI. 2023. Workshop on Touch Processing: a new Sensing Modality for AI.
Link(s) zu Volltext(en)
Access Level
Open Access
Google Scholar