NVIDIA Isaac for Healthcare

Isaac form NVIDIA can already do a lot for healthcare projects. "Over 500 developers joined the Early Access Program, spanning use cases from surgery and imaging to patient services. Highlights include:

Moon Surgical: automating OR setup with intelligent robotic positioning

Moon Surgical is pioneering system-level automation by teaching its robot to configure itself for surgery autonomously. Using onboard cameras and a preference card-driven AI policy, the system detects trocar positions and optimizes its setup based on the surgical case and surgeon’s preferences. From autodocking at the table to deploying robotic arms in the ideal configuration, this workflow streamlines operating room setup and improves consistency across cases.

Virtual Incision: automating needle transfer on the MIRA platform

Virtual Incision showed pre-clinical surgical subtask automation on their miniaturized laparoscopic platform, MIRA, by automating the needle-transfer task. Using transformer-based imitation learning, they trained an AI policy that mimics expert motions and executes with high precision, bringing us closer to scalable autonomy in constrained surgical environments.

Virtuoso Surgical: AI‑powered tissue handling with a concentric‑tube endoscopic robot

Virtuoso Surgical is bringing autonomy to their deformable, concentric-tube robots by training AI to handle delicate tasks like tissue retraction and cutting. Using internal strain feedback from simulated data in NVIDIA Isaac Sim to develop a policy that enables precise manipulation in a soft tissue environment

Sovato: low-latency telerobotics with edge-optimized workflow

Sovato is advancing telerobotic surgery by implementing a latency-optimized workflow tailored for remote procedures. By using GPU-accelerated compute and sensor I/O integration at the edge, they achieved significant performance gains, bringing high-precision, real-time robotic control to geographically distributed operating environments."

You can clone the repos and start building:

git clone https://github.com/isaac-for-healthcare/i4h-workflows.git git clone https://github.com/isaac-for-healthcare/i4h-sensor-simulation.git git clone https://github.com/isaac-for-healthcare/i4h-asset-catalog.git

Source: NVIDIA