Skip to content

[FEATURE] Add new tactile sensors#2735

Draft
Milotrince wants to merge 6 commits intoGenesis-Embodied-AI:mainfrom
Milotrince:new_tactile
Draft

[FEATURE] Add new tactile sensors#2735
Milotrince wants to merge 6 commits intoGenesis-Embodied-AI:mainfrom
Milotrince:new_tactile

Conversation

@Milotrince
Copy link
Copy Markdown
Contributor

@Milotrince Milotrince commented Apr 24, 2026

Description

  • Add point cloud based tactile sensors, PressurePatch (total pressure, center of pressure) and ProximityTaxel (force/torque per taxel) sensors.
    • Adds sample_point_cloud utility using Furthest Point Sampling
  • Split old KinematicContactProbe to ContactDepthProbe (depth only) and KinematicTaxel (force/torque per taxel)
  • Rename old Proximity sensor to SurfaceDistanceProbe
  • Update tactile sensor example to be able to use any of the tactile sensors

Related Issue

Resolves #2676

Motivation and Context

  • More tactile sensors for different use cases
  • Motivation for the renames:
    • Probe -> querying simulation values which could be postprocessed for various use cases
    • Taxel -> mimicking real tactile sensor values

How Has This Been / Can This Be Tested?

Added tests to test_sensors.py

Screenshots (if appropriate):

Screen.Recording.2026-04-24.at.12.25.42.mov
Screen.Recording.2026-04-24.at.12.30.22.mov

Checklist:

  • I read the CONTRIBUTING document.
  • I followed the Submitting Code Changes section of CONTRIBUTING document.
  • I tagged the title correctly (including BUG FIX/FEATURE/MISC/BREAKING)
  • I updated the documentation accordingly or no change is needed.
  • I tested my changes and added instructions on how to test it for reviewers.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

Copy link
Copy Markdown

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 73f04e0579

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment on lines +703 to +706
_fill_probe_effective_r_buffer(
shared_metadata.probe_effective_r_buf,
shared_metadata.probe_radius,
shared_metadata.probe_radius_noise,
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Exclude probe-radius jitter from ground-truth updates

read_ground_truth() is expected to be noiseless, but this ground-truth path samples probe_effective_r_buf with probe_radius_noise, so two identical simulation states can produce different “ground-truth” outputs whenever probe_radius_noise > 0. That corrupts labels for evaluation/training workflows that rely on deterministic ground truth; the same issue also exists in the analogous PressurePatchSensor ground-truth update path.

Useful? React with 👍 / 👎.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm awaiting discussion on #2655 for this. I think we should have a single update_shared_cache instead of update_shared_ground_truth_cache first.

@Milotrince Milotrince force-pushed the new_tactile branch 2 times, most recently from 33c2b3c to 616faae Compare April 24, 2026 18:43
@Milotrince Milotrince marked this pull request as draft May 5, 2026 03:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Tactile sensors based on object point cloud

1 participant