High-interest robot learning pillar
Robot VLA models: from vision and language to action
Learn how robot vision-language-action models connect instructions and observations to actions, and where touch, world models, data, and evaluation fit.
Published 2026-08-20 | Updated 2026-08-22 by Steven Yang
- 6
- sections
- 4
- questions
- 15
- next routes
Short answer
What you need to know
- 1
A robot vision-language-action model, usually shortened to VLA, uses visual observations and language instructions to produce or condition robot actions. Implementations differ in action representation, training data, embodiment coverage, control rate, and whether a separate planner or controller is required.
- 2
A VLA is not automatically a world model or an embodied reasoning system. A world model predicts future state; embodied reasoning can decompose and monitor tasks; a VLA maps observations and instructions toward physical action.
- 3
Touch can extend a VLA during contact-rich manipulation by adding pressure, shear, slip, deformation, or contact-state evidence. The useful test is whether tactile input changes closed-loop outcomes under matched conditions.
Topic 01
What enters and leaves a robot VLA
The common high-level description is vision plus language to action, but real systems also use robot state, action history, camera geometry, embodiment identifiers, depth, force, tactile signals, or a high-level plan. The output may be joint commands, end-effector motion, action chunks, discrete tokens, trajectories, or inputs to another controller.
Because the interface differs, model names and parameter counts do not create a fair performance ranking. Readers need the task, robot, data, action space, inference setting, and evaluation protocol.
Topic 02
VLA, VLM, world model and embodied reasoning
These model categories can be connected inside one system, but they answer different questions. Keeping the roles separate makes research comparisons more useful.
| Model role | Core question | Typical output | Touch opportunity |
|---|---|---|---|
| Vision-language model | What is in the scene and what does the instruction mean? | Text, labels, plans, spatial or semantic representations | Describe contact context or interpret tactile-language pairs |
| Vision-language-action model | What should the robot do next? | Robot action, action token, trajectory, or action chunk | Use live touch to refine contact-rich actions |
| World or world-action model | What state may follow this action? | Predicted visual, tactile, latent, reward, or contact future | Predict slip, force-related state, or future tactile observations |
| Embodied reasoning system | How should a long task be decomposed, monitored, and recovered? | Subgoals, tool calls, constraints, or task status | Use contact as evidence that a physical step succeeded or failed |
Topic 03
Data and embodiment determine the model boundary
Robot data is heterogeneous: cameras, calibration, joint layouts, control spaces, grippers, hands, task labels, demonstration quality, and reset policies differ across platforms. A multi-embodiment model must represent those differences rather than assume that all actions share the same meaning.
Dataset size alone does not establish coverage. Evaluate which robots, tasks, environments, failure cases, sensor streams, and licenses are present, and whether test splits prevent leakage from repeated trajectories or objects.
Topic 04
Where tactile sensing fits
Most VLA descriptions start with images and instructions. Contact-rich tasks create a second timescale: visual planning may operate relatively slowly while slip, force, or local deformation can require faster feedback. A tactile pathway can enter the main policy, a specialized contact controller, a predicted future, or a high-frequency correction layer.
The reviewed tactile systems now expose six materially different integration paths. T-Rex adds multi-rate tactile refinement; ReTouch recursively refreshes predicted touch and the remaining action suffix; τ uses future visual change to supervise tactile representations during training; UniTacVLA combines semantic touch reasoning, future-touch prediction, and residual correction; ViTaR restricts touch to bounded residual modulation around a frozen VLA; and VLA-Touch separates tactile-assisted planning from action interpolation.
Their source-reported results belong to different robots, datasets, trial units, scoring rules, baselines, and artifact states. The mechanism map below preserves those boundaries and deliberately publishes no cross-paper rank score.
Topic 05
How to evaluate a robot VLA
A robust evaluation should identify the training resources, robot embodiment, task family, visual conditions, action interface, control rate, inference hardware, intervention rules, and real-robot trial protocol. Generalization should name what changed: object, scene, instruction, robot, sensor, task, or dynamics.
- Compare against matched policy and no-language or no-touch ablations where the claim requires them
- Report task completion, speed, recovery, safety constraints, and physical side effects rather than only offline loss
- Separate simulation, replay, benchmark, staged demonstration, and repeated real-robot evidence
- Check whether the model, code, weights, data, and evaluation procedure are actually accessible
Topic 06
Current model ecosystem
The source-reviewed index below separates eleven VLA records. Gemini Robotics 2, RT-2, OpenVLA 7B, π0, and Isaac GR00T N1 do not document live tactile input in the reviewed releases. T-Rex, ViTaR, ReTouch, τ, UniTacVLA, and VLA-Touch do, but only T-Rex currently exposes a comparatively complete combination of public checkpoints, model code, inference code, and a downloadable tactile dataset subset.
Artifact labels are literal rather than promotional: ReTouch is paper-only; ViTaR and τ say code is coming; UniTacVLA remains a project-page placeholder; VLA-Touch exposes partial code, data, and controller checkpoints but still marks its modified RDT inference implementation for future release. A paper, repository shell, dataset, controller checkpoint, and complete reproducible policy are not treated as equivalent.
RoboSkin.ai does not treat those official descriptions as proof of equivalent capability. This page owns the VLA and action-policy role; the robot foundation-model directory owns broad pretraining, transfer, access, and evidence comparisons, while tactile foundation-model, world-model, dataset, benchmark, and manipulation pages hold narrower technical evidence.
Source-reviewed evidence index
VLA interfaces, embodiments, access and touch
This server-rendered index includes only records whose central model role is VLA. It does not rank unlike systems. Each row preserves the reported input and action interface, real-robot boundary, artifact status, and direct primary sources, while the full canonical entity remains in the Robot AI Model Directory.
- 11
- verified VLA records
- 6
- with verified tactile input
- Primary
- source requirement
| Model / release | Inputs / action output | Verified embodiments | Real-robot evidence | Training / access / touch | Evidence boundary / sources |
|---|---|---|---|---|---|
| Gemini Robotics 2Google DeepMindFull evidence record | Inputs: Text instruction; RGB image Output: Motor-control actions |
| Google DeepMind reports developer-run whole-body, multi-finger, and parallel-gripper task trials on Apollo 2 and Franka Duo configurations. | Training / data: The reviewed official model page and release post do not disclose the training-mixture composition, example count, or complete data provenance. Access: Private preview; organizations can join the official early-access waitlist. License: Model weights and a reusable model license are not publicly disclosed; access is governed by private-preview terms. Tactile input: No | The public model specification lists text and image inputs, not touch. Results are developer-reported on selected hardware and tasks; no public weights, training recipe, neutral cross-platform benchmark, or model-specific research paper was verified.Reviewed 2026-08-21 |
| RT-2Google DeepMindFull evidence record | Inputs: Robot-camera image; Natural-language instruction Output: Tokenized robot actions |
| The paper reports 6,000 evaluation trials covering seen and unseen task conditions on the authors’ real-robot setup, alongside Language Table simulation tests. | Training / data: PaLM-E- and PaLI-X-based variants were co-fine-tuned on web-scale vision-language data and RT-1 robot demonstrations gathered with 13 robots over 17 months. Access: Paper and official technical description are public; model weights and a runnable training implementation were not released. License: No public model-weight license was disclosed because weights were not released. Tactile input: No | RT-2 is a closed research model evaluated mainly within the authors’ mobile-manipulation environment. Its image-and-language interface does not document tactile input, and reported generalization should not be transferred to untested robots, sensors, tasks, or safety conditions.Reviewed 2026-08-21 |
| OpenVLA 7BStanford University, UC Berkeley, Toyota Research Institute, Google DeepMind, Physical Intelligence, and MITFull evidence record | Inputs: Natural-language instruction; RGB robot observation Output: Discretized robot actions |
| The paper reports real-world evaluation across 29 manipulation tasks and multiple robot embodiments, comparing task success with generalist-policy baselines. | Training / data: The flagship 7B model was trained on 970,000 real-world robot trajectories from the Open X-Embodiment mixture. Its published mixture includes DROID at 10% before DROID is removed for the final third of training, plus a 13.3% Bridge bucket that combines Bridge V1 and BridgeData V2 rather than reporting a V2-only share. Access: Training and inference code plus pretrained checkpoints are public through the official project and repository. License: Repository code is MIT; the maintainers state that pretrained models can inherit restrictions from their underlying base models, so each checkpoint’s terms must be checked. Tactile input: No | The released flagship model is vision-language-action rather than tactile. Reported task success is tied to the paper’s action representation, data mixture, platforms, and protocol; “open source” does not remove inherited base-model license restrictions.Reviewed 2026-08-22 |
| π0 (Pi Zero)Physical IntelligenceFull evidence record | Inputs: RGB images; Natural-language instruction; Low-dimensional robot state Output: Continuous robot-action chunks generated by flow matching |
| The original release evaluates five complex real-world task families, including laundry folding, table bussing, grocery bagging, box assembly, and object retrieval. | Training / data: The original report combines a pretrained vision-language backbone with 903 million steps of proprietary robot data plus a 9.1% open-source mixture containing an Open X-Embodiment subset, BridgeData V2, and DROID; it does not disclose separate weights for those three sources. Current OpenPI base checkpoints report pretraining on more than 10,000 hours of robot data. Access: OpenPI publishes Apache-2.0 code, base checkpoints, and selected task-specific checkpoints; the maintainers warn that adaptation to a new platform may fail. License: Apache-2.0 for the OpenPI repository; users must also follow the licenses attached to checkpoints, base-model components, and training datasets. Tactile input: No | The published input schema uses images, language, and robot state rather than touch. Original comparisons use the authors’ scoring rubric and platforms; current open checkpoints and code have evolved since the 2024 report and do not guarantee reproduction on other hardware.Reviewed 2026-08-22 |
| Isaac GR00T N1NVIDIAFull evidence record | Inputs: Natural-language instruction; RGB image; Robot state Output: Robot actions from a vision-language module and diffusion-transformer action module |
| The N1 research page reports language-conditioned bimanual household manipulation on Fourier GR-1 and 1X humanoids, plus simulation benchmarks across embodiments. | Training / data: NVIDIA reports a mixture of egocentric human video, real robot trajectories, simulated robot trajectories, and synthetic data; complete example counts and item-level provenance are not disclosed in the research page. Access: The Isaac-GR00T repository publishes code and model checkpoints; the maintained family has advanced beyond the paper’s N1 release. License: Repository code is Apache-2.0 and model weights use the NVIDIA Open Model License; exact terms must be checked for the selected version. Tactile input: No | The N1 report does not document tactile input. Real-robot evidence is developer-reported on named humanoids and household tasks; current repository defaults may implement later N1-family versions, so version-matched checkpoints and evaluations are required.Reviewed 2026-08-21 |
| T-RexUC Berkeley, NVIDIA, Stanford University, Panasonic, Sapienza University of Rome, and ItalAIFull evidence record | Inputs: Natural-language instruction; Head and bilateral wrist RGB video; Robot state; Ten fingertip tactile deformation streams and 6D wrench estimates Output: Bimanual robot-action chunks with approximately 5 Hz slow action generation and 20 Hz tactile refinement |
| The official project reports a 65% macro-average for T-Rex versus 35% for EgoScale across 12 contact-rich tasks, with 16 randomized rollouts per task on one fixed-base bimanual setup. | Training / data: The authors report three stages: large-scale tactile-free egocentric pretraining, tactile-reactive midtraining on the full 100-hour T-Rex collection, and task-specific post-training. The current public dataset card specifies 5,464 episodes and 5,473,459 frames at 30 FPS, approximately 50 hours, rather than the complete 100-hour training corpus. Access: Paper, project page, MIT-licensed repository, pretrained and midtrained checkpoints, post-training and inference code, full-pipeline branch, and an approximately 50-hour LeRobot v3.0 dataset subset are public. License: The official repository, Hugging Face midtraining checkpoint, and public dataset card are marked MIT; upstream models, dependencies, hardware assets, and any unbundled corpora retain their own terms. Tactile input: Yes | T-Rex is a June 2026 arXiv preprint with developer-run results on one Dexmate Vega-1 and dual Sharpa Wave configuration. The 65% score uses source-defined progress rubrics, and the released approximately 50-hour subset is not the complete 100-hour corpus used for tactile-reactive midtraining; no independent reproduction or cross-platform evaluation was verified. T-Rex preprint ↗T-Rex official project ↗T-Rex official repository ↗T-Rex midtraining checkpoint card ↗ Reviewed 2026-08-22 |
| ViTaRBeijing Institute of TechnologyFull evidence record | Inputs: Natural-language instruction; Primary scene or head RGB image; Wrist RGB image; Robot proprioception; Marker-derived contact descriptor; Bilateral tactile-image summary Output: Frozen OpenVLA-OFT action chunk plus an optional bounded 7D end-effector residual selected and scaled from current contact evidence |
| The authors report binary end-to-end success on three physical tasks with 20 trials per method-task pair: 40% on Insert Hole, 65% on Lift Bottle, and 40% on Wiping the Board, or 48.3% across those tasks. A separate seven-task UniVTAC protocol uses 100 episodes per method-task pair and reports a 61.3% average. | Training / data: The frozen OpenVLA-OFT reference is fine-tuned on 50 UniVTAC trajectories per task across seven tasks. ViTaR additionally uses 20 restored decision groups per task and short local branches to supervise effect ranking and residual modulation; trajectory, decision-group, branch, and preference-pair counts are different units and are not combined here as one demonstration total. Access: Paper, official project page, video, figures, and project-page source are public. The official page marks code as “Coming soon”; no runnable ViTaR implementation, model weights, EGM or RAM checkpoints, exact branch corpus, or ViTaR-specific dataset download was verified. License: No separate software, model-weight, checkpoint, or ViTaR-specific dataset license was published because those artifacts were not released. The upstream UniVTAC terms do not license ViTaR artifacts. Tactile input: Yes | ViTaR is an August 2026 v1 preprint with author-reported evidence. Its 61.3% UniVTAC binary-success average and 48.3% physical average use different cohorts and must not be combined or ranked against unlike VLA protocols. Imported, adapted, and author-evaluated baselines do not share identical upstream data, seeds, or interaction budgets, and ViTaR receives additional branch supervision. Physical evidence is limited to one RM65-B configuration, three tasks, and 20 trials per task; no independent reproduction, cross-robot transfer, or public implementation was verified.Reviewed 2026-08-22 |
| ReTouchUniversity of Science and Technology of China, iFLYTEK, and The Chinese University of Hong KongFull evidence record | Inputs: Natural-language task instruction; One wrist-mounted RGB view; Two fixed external RGB views; 18-dimensional robot proprioception; Current frame plus the preceding nine frames from five fingers with 120 three-axis force taxels per finger (a ten-frame input window) Output: Sixteen-step chunks of 18-dimensional absolute joint-position commands, with the remaining suffix regenerated from updated tactile observations during execution |
| The standard protocol uses 20 real-robot rollouts per method on each of seven tasks and reports an 83.6% macro-average normalized task score. Button Press is binary, while the other six tasks award weighted partial credit. Four separate challenging settings also use 20 rollouts per method-setting and report a 73.1% macro-average for ReTouch. | Training / data: XHT-Dataset contains 900 retained successful demonstrations across seven real-world tasks. The paper holds out 100 trajectories from tactile-encoder and policy training and uses the remaining 800 as a common training pool; it does not disclose the per-task distribution or publish the split manifest or dataset files. Access: The current arXiv v2 paper is public. No paper-linked official project page, source-code repository, model weights, checkpoints, XHT-Dataset download, or exact split manifest was verified on 2026-08-22. License: No separate ReTouch software, model-weight, checkpoint, or XHT-Dataset license was verified because those artifacts were not publicly released. Tactile input: Yes | ReTouch is an August 2026 preprint evaluated by its authors on one XHand–UR7e setup. The paper calls the primary quantity “Success Rate,” but Appendix B defines it as a normalized task score and only one of seven tasks is binary; 83.6% therefore must not be described as 83.6% fully completed trials. One on-site evaluator applies the rubric, each task or challenge has 20 rollouts per method, and no confidence intervals, public logs, independent replication, artifact release, or cross-platform evaluation was verified.Reviewed 2026-08-22 |
| τ (Touch-Augmented VLA)Beijing Jiaotong University and Beijing Institute for General Artificial IntelligenceFull evidence record | Inputs: Natural-language instruction; Multi-view RGB observation; Robot proprioception; Bilateral vision-based tactile deformation Output: Future robot-action chunks generated by a π0.5-based conditional flow-matching policy; exact action dimension and semantics are not reported |
| Each fixed model variant is evaluated for 20 trials per task across four physical tasks. The best fixed variant by the paper’s reported mean is τ-Wrist at 71.25%, with full-task success of 60%, 40%, 90%, and 95%; a separate sentence mixes best task values from different variants and is not treated as one checkpoint result. | Training / data: TacAura supplies 100 human-teleoperated demonstrations per task across plug insertion, USB insertion, stamp pressing, and whiteboard erasing. A JEPA-style auxiliary branch uses current touch and subsequent actions to predict future visual-feature changes during training; that predictive branch is removed at inference, while tactile input remains part of the deployed policy. Access: The arXiv v3 paper and project page are public. The project labels code “Coming Soon,” but its button points to a separate STOLA placeholder; no τ implementation, model weights, TacAura download, data-conversion tools, or reusable artifact license was verified. License: No software, model-weight, or TacAura dataset license was verified because the promised artifacts were not released. Tactile input: Yes | τ is a July 2026 preprint with author-run results on one Franka Research 3 and bilateral DM-Tac WS configuration. Baselines marked with a dagger were adapted to the authors’ tactile setup; results do not establish cross-embodiment or cross-sensor transfer. The paper does not report exact action semantics or deployment rate, omits tactile-aware world-model comparisons for computational reasons, and had not released code, weights, or TacAura by 2026-08-22. “No deployment overhead” applies only to removing the training-only predictive branch, not to the tactile sensing and encoding path used at inference.Reviewed 2026-08-22 |
| UniTacVLAHarbin Institute of Technology, Great Bay University, Shanghai Jiao Tong University, Fudan University, Nanjing University, and Daimon RoboticsFull evidence record | Inputs: Natural-language instruction; Wrist and first-person RGB observations; Robot state; Bilateral depth and shear tactile deformation; Predicted future tactile latents Output: Low-frequency π0.5 action chunks plus bounded high-frequency residual corrections conditioned on current and predicted tactile latents; exact action dimensions and rates are not reported |
| Eight subtasks are evaluated in clean and perturbed settings with 50 trials per subtask-setting. The paper publishes all 16 task-setting success rates but not an aggregate number, so RoboSkin preserves the per-task protocol rather than presenting a calculated mean as a paper-reported score. | Training / data: The paper reports approximately one hour of 30 Hz demonstrations per subtask across eight subtasks, with 80% normal expert demonstrations and 20% disturbance-recovery demonstrations. It does not disclose trajectory or frame counts, a named public dataset, an exact split manifest, or a downloadable corpus. Access: The arXiv v1 paper is public, while the official repository contains only a “coming soon” project-page placeholder. No implementation, checkpoint, training dataset, release, tag, or reuse license was verified. License: No public software, model-weight, or dataset license was verified because the repository remains a project-page placeholder without released artifacts. Tactile input: Yes | UniTacVLA is a June 2026 v1 preprint evaluated by its authors on one RM75B, one custom gripper, and two DM-Tac W sensors. The table reports 50 trials for each clean or perturbed subtask setting but no aggregate mean; calculated averages must not be presented as author-reported. Exact action dimensions, backbone and controller rates, trajectory count, tactile pixel resolution, severe-occlusion performance, explicit force or torque modeling, code, checkpoints, public data, and independent reproduction remain unavailable.Reviewed 2026-08-22 |
| VLA-TouchNational University of SingaporeFull evidence record | Inputs: Natural-language task goal; Overhead and wrist RGB observations; Robot proprioception; GelSight Mini tactile images; Octopi tactile-language descriptions; Marker-tracked low-dimensional tactile state Output: High-level primitive instruction plus an RDT-1B 64-step action chunk refined by a tactile and vision-conditioned interpolant controller |
| The complete planning-and-manipulation system is evaluated for 20 trials on each of three tasks and reports 9/20 complete Cup trials, 12/20 complete Wipe trials, and 7/20 complete Peel trials. Separate component tables also use 20 trials per condition and must not be merged with these end-to-end counts. | Training / data: The base RDT-1B policy is first aligned to the Franka action space and then fine-tuned per task without tactile input. The interpolant controller is trained on paired VLA-generated and expert action sequences from 380 demonstrations across the Cup, Wipe, and Peel task pipelines; the exact RDT task-checkpoint release is not verified. Access: The official MIT-licensed repository publishes partial controller and Octopi code and links a public processed dataset plus controller checkpoints. The modified RDT inference implementation is still marked for future release, no complete task-fine-tuned RDT checkpoint was verified, and the repository has no GitHub release. License: MIT applies to files in the official GitHub repository. No separate license was verified for the linked dataset, Drive-hosted controller checkpoints, Octopi data, or upstream RDT-1B artifacts. Tactile input: Yes | VLA-Touch is a modular wrapper rather than a released tactile-native foundation model. Evidence is limited to one single-arm Franka setup, one unilateral GelSight Mini, three tasks, and 20 trials per task. The authors test source-defined environmental variations rather than cross-task, cross-robot, or cross-sensor generalization. Octopi, GPT-4o, RDT-1B, BRIDGeR-derived control, data, and checkpoints have separate boundaries; the repository MIT license must not be generalized to those external or hosted artifacts, and the complete modified RDT deployment path remains unreleased.Reviewed 2026-08-22 |
Tactile VLA mechanism map
Six ways touch enters the action loop
These systems do not implement one interchangeable “tactile VLA” design. This evidence layer separates direct fusion, predictive supervision, future-touch refinement, slow-fast correction, bounded modulation, and dual-level planning. Reported scores remain inside each source protocol and are never normalized into a leaderboard.
6
mechanism records
0
cross-paper rank scores
2026-08-22
source review date
| System / integration role | Where touch enters | Action and control path | Evaluation / metric unit | Artifact boundary | Evidence boundary / sources |
|---|---|---|---|---|---|
| ViTaRbounded residual modulationCanonical model record | A marker-derived contact descriptor helps choose whether to retain the frozen VLA action or select a structured residual; a bilateral tactile summary scales the chosen residual with a gain in [0, 1]. | Frozen OpenVLA-OFT chunk → retain or select one bounded 7D residual direction → apply the same scaled residual across the chunk. Touch cannot invent a new base direction or alter the candidate set. | Evaluation unit: Seven UniVTAC tasks use 100 episodes per method-task pair; three physical RM65-B tasks use 20 trials per method-task pair. Metric: End-to-end binary task success. The reported 61.3% UniVTAC and 48.3% physical averages come from different cohorts and are not combined. | Paper and project page public; official page says code is coming soon. No runnable model, weights, EGM or RAM checkpoints, or exact branch corpus verified. | Author-reported v1 preprint evidence. Imported, adapted, and newly evaluated baselines do not establish equal upstream data, seed, or interaction budgets; physical evidence is limited to one configuration and three tasks.Reviewed 2026-08-22 |
| ReTouchonline tactile prediction refinementCanonical model record | A finger- and patch-aware encoder processes the current tactile frame plus the preceding nine frames, forming a ten-frame input window of dense five-finger force taxels. The deployed Foresight Action Expert recursively refreshes predicted tactile latents as new touch arrives. | Cached 9 Hz visual-language context → 36 Hz model-only Foresight Action Expert passes → regenerate the unexecuted suffix of a 16-step absolute joint-position chunk at offsets 4, 8, and 12. | Evaluation unit: Seven standard tasks and four separate challenge settings use 20 real-robot rollouts per method-task or method-setting on one XHand–UR7e platform. Metric: A normalized task score. Only Button Press is binary; the other six standard tasks award weighted partial credit, so the reported 83.6% macro-average is not a full-completion rate. | Paper only. No official implementation, checkpoint, XHT-Dataset download, split manifest, evaluation log, or artifact license verified. | Author-reported results with one on-site evaluator and no confidence intervals or independent replication. The 9 Hz and 36 Hz values are RTX 5090 model-only rates that exclude communication and controller scheduling.Reviewed 2026-08-22 |
| τ (Touch-Augmented VLA)future-visual supervised tactile fusionCanonical model record | Bilateral vision-based tactile deformation is encoded and fused into a pretrained π0.5 policy. During training, current touch and subsequent actions predict future visual-feature change; that auxiliary JEPA-style branch is removed at inference. | Multi-view RGB + language + proprioception + live bilateral touch → fused VLA representation → flow-matched future action chunk. Live touch remains an inference input even though the predictive supervision branch is removed. | Evaluation unit: Four physical tasks use 20 trials per fixed model-task pair on one Franka Research 3 and bilateral DM-Tac WS configuration. Metric: Stage and full-task success. The best fixed variant by reported mean is τ-Wrist at 71.25%; a textual list mixing best task values from different variants is not treated as one checkpoint result. | Paper and project page public; code is labeled coming soon and links to a separate placeholder. No τ implementation, weights, TacAura download, or reuse license verified. | Author-run preprint evidence with tactile baselines adapted to the local sensor setup. No cross-robot or cross-sensor transfer is tested, and “no deployment overhead” applies only to the removed auxiliary branch.Reviewed 2026-08-22 |
| UniTacVLApredictive tactile residual controlCanonical model record | Unified tactile tokens receive semantic contact-state supervision and coarse-to-fine future tactile prediction. Current and predicted tactile latents both condition a separate action-tactile mixed controller. | π0.5 low-frequency action chunk → predicted tactile prior + current touch + robot-state update → bounded high-frequency residual correction. The paper does not disclose either rate or the action dimension. | Evaluation unit: Eight physical subtasks are each tested in clean and perturbed settings with 50 trials per subtask-setting on one RM75B configuration. Metric: Per-subtask binary success rates. The paper table does not print an aggregate mean, so RoboSkin does not label a calculated overall average as author-reported. | Paper public; official repository is a one-line coming-soon project placeholder with no code, checkpoints, dataset, release, tag, or license. | Author-reported v1 evidence on one custom gripper and sensor pair. Exact trajectory count, tactile resolution, action interface, control rates, severe-occlusion evidence, public data, and independent reproduction are unavailable.Reviewed 2026-08-22 |
| T-Rexmulti-rate tactile action refinementCanonical model record | Ten fingertip deformation streams and derived wrench estimates provide a fast tactile-reactive path alongside head and wrist video, language, and robot state. | Approximately 5 Hz slow VLA action generation → approximately 20 Hz tactile refinement → bimanual action chunks for a fixed Dexmate Vega-1 and dual Sharpa Wave configuration. | Evaluation unit: Twelve contact-rich tasks use 16 randomized rollouts per task on one fixed-base bimanual platform. Metric: Source-defined progress or success rubrics with a reported 65% macro-average. This protocol is not a shared leaderboard with the other tactile VLA records. | MIT repository, checkpoints, training and inference code, and an approximately 50-hour public LeRobot subset are available; the public subset is not the complete reported 100-hour corpus. | Developer-run preprint evidence on one platform. No independent reproduction or cross-platform evaluation is verified, and the released data boundary must remain separate from the full training-corpus claim.Reviewed 2026-08-22 |
| VLA-Touchdual-level planning and action refinementCanonical model record | At the planning level, Octopi and marker tracking turn GelSight observations into linguistic tactile evidence for GPT-4o. At the execution level, marker-tracked touch conditions an interpolant controller around a non-tactile RDT-1B policy. | Tactile-informed primitive instruction → RDT-1B 64-step source chunk → DINOv2, robot state, and tactile-conditioned interpolant refinement of the action chunk. | Evaluation unit: Cup, Wipe, and Peel each use 20 end-to-end trials on one Franka Panda, Robotiq 2F-140, and unilateral GelSight Mini setup. Metric: Binary end-to-end counts for the complete system: 9/20 Cup, 12/20 Wipe, and 7/20 Peel. Separate planning and manipulation component tables are not merged into those counts. | MIT repository with partial controller and Octopi code plus linked data and controller checkpoints. Dataset and hosted checkpoint licenses are not verified, and the modified RDT inference implementation remains unreleased. | A modular wrapper rather than a tactile-native foundation VLA. Evidence is task- and hardware-specific; it does not establish cross-task, cross-robot, or cross-sensor generalization or a complete reproducible deployment path.Reviewed 2026-08-22 |
Paper routes
Start with source-backed RoboSkin briefs
Tactile manipulation / 2026-08-22T-Rex adds high-rate tactile reaction to dexterous robot policiesT-Rex reports a 100-hour collection and a 30-point gap over EgoScale; its official release now provides code, checkpoints, and an approximately 50-hour public subset.
Tactile AI / 2026-08-15FeelWorld predicts contact, tactile force states, and slip for robot planningFeelWorld adds explicit contact, force-related tactile, and slip prediction to a visual world model for contact-rich robot planning.Tactile AI / 2026-08-15Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot ManipulationDream-Tac models action-conditioned tactile futures for contact-rich robot manipulation, showing why robot skin data needs prediction, not only reaction.Common questions
FAQ for this topic
What is a robot VLA model?
A robot vision-language-action model uses visual observations and language instructions to produce or condition robot actions. Architectures and action interfaces vary, so the term does not specify one model design.
Is a VLA the same as a robot foundation model?
Not always. A VLA may be trained as a broad reusable foundation model or for a narrower robot and task set. Foundation-model claims require evidence for transfer, adaptation, or reuse.
Do robot VLA models use touch?
Some do, but many are vision-language-action systems without live tactile input. Touch may be fused into the policy, used by a fast correction layer, or predicted by a world model.
How should VLA models be compared?
Compare them only after aligning robot embodiment, tasks, inputs, action space, data, baselines, control rate, and real-robot evaluation. Unlike settings should not be collapsed into a leaderboard.