ESR4 - Sensory Feedback for Prosthetic Devices

To develop, and implement in robots, a biologically-inspired mathematical model of how spatiotemporal patterns of tactile information can be efficiently encoded and recalled for the selection of action and control of behavior.

TAGS   Biological Touch   Prosthetics   Technologies for Touch

Overview

Objectives

To develop, and implement in robots, a biologically-inspired mathematical model of how spatiotemporal patterns of tactile information can be efficiently encoded and recalled for the selection of action and control of behavior. The core of the proposed method is a computational framework, that mimics the compression, chunking and consolidation and recall functions of mammalian episodic memory. The approach is based on a family of Bayesian, latent variable models referred to as “Deep Gaussian Process” (DGP) that offers a probabilistic framework for modelling complex data in (un/semi)-supervised mode, and is therefore well-suited as a platform for perception and learning in robotics. This framework has already been validated for three aspects of robot perception: face recognition, arm/hand action recognition and passive touch gesture recognition using the iCub humanoid robot (FP7 WYSIWYD project). Results show the capacity of our proposed method for integration of sensory data, adaptability and accurate perception in real-time. The current project will extend this approach to active touch for the control of tactile object exploration and manipulation. The principled handling of uncertainty in the perception and prediction stages, through the Bayesian probabilistic formulation, constitutes a promising path to the development of applied systems for assistive and industrial robotics that will be explored during the secondment part of the studentship.

Expected Results

A probabilistic framework for integration, storage and recall of tactile memories using generative Gaussian process models inspired by perceptual coding, learning and episodic memory systems in the mammalian brain. The system will be evaluated in iCub robot as a contributor to multi-sensory guidance of active sensing, action selection, and object exploration/manipulation. Results will also be generalized from the iCub to more conventional industrial or assistive robotic systems.

Secondments

  • IIT-CNCS

    learn information theory tools for neural coding

  • IIT-iCub

    test neural coding on a robotic platform for implementing behavior

  • PAL (Terreri)

    test on a different robotic platform (generalization)

Supervisors

  • T. Prescott

  • S. Panzeri
  • C. Bartolozzi

  • L. Natale

  • S. Terreri

Pablo Jose Salazar Villacis

During my academic formation, I have acquired skills with electronics, sensors, and control theory. That experience has led me to keep exploring and geting knowledge about robotics, autonomous systems. Emphasizing how artificial intelligence can be integrated to develop tools that mimic cognitive processes in robots.

Neutouch for me

NeuTouch is an outstanding opportunity that encourages us and provides the means to grow personally and professionally. In NeuTouch, we aim to contribute to the development of science and technology by combining different contributions from a multidisciplinary bundle of professionals.

Info

  • Research Topics

    Robotics, Computational Neuroscience

  • Institution

    University of Sheffield

  • Background

    B.Sc. Electronics and Instrumentation Engineer (Universidad de las Fuerzas Armadas ESPE, 2017)
    M.Sc. Automation and Robotics (Universidad Politécnica de Madrid, 2019)

This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 813713 ).
© Neutouch Project