01
GPU Medical Volume Rendering
- Real Hounsfield Unit CT data
- 3D Metal texture sampling
- Front-to-back ray marching
- Gradient-based lighting
- Preset-specific opacity and color transfer functions
Apple Vision Pro · Medical Imaging · Spatial Computing
Apple Vision Pro Medical XR · Immersive CT Visualization with Metal & visionOS
- Metal CT ray marching
- Bone · CTA · Soft Tissue · Lung
- Axial · Coronal · Sagittal
- Rotate · Pan · Zoom · W/L
- macOS · Xcode · visionOS
Native Apple-platform engineering prototype · validated in Apple Vision Pro visionOS 26 Simulator
Visual Showcase
Apple Vision Pro Medical XR
Video and all five screenshots are presented first, with short engineering keywords only.
Volume Rendering Presets
CTA · Bone · Soft Tissue · Lung
Core Capabilities
What the Project Demonstrates
02
Apple Vision Pro / XR
- Immersive visionOS workspace
- CompositorLayer / LayerRenderer integration
- ARKit world-tracking support
- Spatial placement of 3D volume and CT slice panels
- Stable enter / exit immersive lifecycle
03
Orthogonal CT Slice Visualization
- Axial XY view at selected Z
- Coronal XZ view at selected Y
- Sagittal YZ view at selected X
- Shared voxel state and synchronized crosshairs
- Window / Level adjustment
04
Interactive 3D Navigation
- Rotate
- Pan
- Zoom
- Reset view
- Opacity and rendering-preset control
Rendering Architecture
CT Data to Apple Vision Pro
01 · Input
CT / HU Volume
Validated CT dimensions and physical voxel spacing
02 · Bridge
Float16 Volume
Compact medical-volume representation for the visionOS prototype
03 · GPU
MTLTexture3D
512 × 512 × 107 native Metal 3D texture
04 · Render
Metal Ray Marcher
HU mapping, opacity integration, gradients and lighting
05 · Spatial
CompositorServices
Immersive Apple Vision Pro presentation
Engineering Highlights
Apple Platform + Low-Level GPU Development
- Native Apple development workflow
- visionOS simulator validation
- Metal shader compilation and debugging
- Custom volume ray-marching shaders
- 3D texture sampling
- Medical transfer functions
- Volume dimensions preserved
- Voxel spacing used for physical aspect ratio
- Shared X / Y / Z slice state
- Thread-safe state bridge
- Preset / slice / transform controls
- Simulator-friendly interaction
- LayerRenderer frame loop
- Immersive enter / exit handling
- Invalid-frame protection
- Windows C++ medical workstation
- Apple Vision Pro spatial renderer
- Same domain across two GPU stacks
Technology Stack
Native Apple XR & Medical Visualization
macOSDevelopment host
XcodeBuild, simulator and debugging
SwiftApplication and renderer integration
SwiftUIControl surface and state UI
MetalGPU volume and slice rendering
CompositorServicesImmersive low-level rendering
ARKitWorld tracking support
visionOSApple Vision Pro target platform
MTLTexture3DCT voxel storage on GPU
GPU Ray MarchingVolume integration
CT / HUMedical transfer functions
Spatial InteractionRotate · pan · zoom · slices
Cross-Platform Medical Engineering
Desktop Medical AI + Apple Vision Pro XR
Windows Medical Imaging & AI
- C++17 / Qt 6 / VTK
- DICOM visualization and processing
- OpenGL GPU rendering
- ONNX Runtime / MONAI AI integration
- Desktop analysis workflow
Apple Vision Pro Medical XR
- Swift / SwiftUI
- Metal GPU volume rendering
- CompositorServices
- ARKit / spatial presentation
- visionOS immersive visualization
Project Scope
- Portfolio and R&D engineering visualization prototype
- Focused on graphics, spatial computing and medical-data presentation
- Validated in the Apple Vision Pro visionOS Simulator
- Not a clinically validated medical device
- Not intended for diagnosis, treatment decisions or patient care
XR · GPU · Medical Visualization
Spatial Visualization Engineering
- Apple Vision Pro / visionOS
- Metal GPU rendering
- Medical / scientific visualization
- Cross-platform graphics R&D