Tactile-JEPA: Topology-Aware Self-Supervised Representation Learning for Distributed Tactile Sensors

The paper introduces Tactile-JEPA, an efficient self-supervised pre-training method that leverages the spatial arrangement of distributed tactile sensors to learn topology-aware representations. It predicts embeddings of masked sensing elements from unmasked counterparts using a sensor connectivity graph, and employs dual-scale masking to capture both local contact details and global surface state. Evaluated across three diverse datasets, Tactile-JEPA consistently outperforms prior state-of-the-art methods in downstream tasks like force and orientation estimation.

Tactile-JEPA reduces force estimation error by 6.3% over the prior state-of-the-art.

In-hand orientation error is reduced by 20.8% over the prior state-of-the-art.

Consistent gains are observed in other downstream applications, including policy learning.