Operating in high-stakes emergency trauma presents a lethal paradox: peripheral veins collapse under severe hypovolemic shock, rendering them invisible to the naked eye, while surgeons and paramedics have their hands locked in sterile fields holding needles, scalpel blades, and cannulas. Reaching out to touch a portable ultrasound monitor or mobile tablet breaches sterility and risks fatal cross-contamination.
To solve this, I built BioSurg AR v3.0 for the Learn AR with SPECS Hackathon—a zero-touch, hands-free spatial AR surgical copilot engineered specifically for Snap SPECS.
🌐 Quick Links & Live Demos
- 🚀 Live Production Simulator: https://biosurg-ar.vercel.app
- 🌐 Alternative Live Mirror: https://fokrulanthro16-eng.github.io/biosurg-ar/
- 💻 Open-Source GitHub Repo: https://github.com/fokrulanthro16-eng/biosurg-ar
- 🎥 Full Video Demonstration: https://youtu.be/zc10LdPOyUo
👓 Engineered for the 3 Core Snap SPECS Spatial Rules
1. Shares Your View (Optical Biometric Lock & Gaze-Dwell)
BioSurg AR locks onto forearm geometry with high-precision SLAM tracking. Instead of cluttering the surgeon's perspective, a 1.5-second Gaze-Dwell reticle allows the operator to select and lock the target vessel (Cephalic, Basilic, or Median Cubital) entirely hands-free.
2. Draws in the World at 1:1 Metric Scale (Zero 2D Floating Windows)
- Sub-Surface Scattering (SSS) Shaders: Custom GLSL shaders render pulsating hemodynamic micro-particles at the patient’s cardiac cycle (110 BPM trauma pulse).
- 25° Holographic Cannulation Trajectory: A dynamic laser guide projects the insertion vector with real-time millimeter depth telemetry (0.0mm to 4.2mm lumen penetration).
- Arterial Danger Zone Alert: If the insertion trajectory approaches within $\le 3\text{mm}$ of the radial artery, the system triggers a volumetric crimson strobe alarm.
- Exploded Anatomical View: Separates epidermis (+18mm), fascia, and vascular bed in 3D world space.
3. Leaves Hands 100% Free (Voice-Driven FSM)
Using a deterministic Finite State Machine, surgeons execute complex multi-layer views using natural voice commands ("Scan Vessels", "Cross Section", "Guide Needle", "Confirm Access") without touching any physical surface.
🔊 Procedural Doppler Spatial Acoustics (Web Audio API)
BioSurg AR incorporates a real-time procedural pulsed-wave Doppler ultrasound audio synthesizer. Utilizing biquad low-pass filter occlusion, blood flow sounds remain muffled at -16 dB while tissue layers are closed, instantly transitioning to 0 dB full-spectrum acoustic harmonics when an exploded cross-section is activated.
🧪 Compliance & 14/14 LEAF Automated Verification
Planned via the Devpost Learn skill pack and built with Snap CLAD and Lens Studio MCP, the system passes an automated 14-point LEAF verification suite verifying SLAM registration, latency (<150ms), and optical luminance budget cap (<8% FOV occlusion). Every cannulation event is signed into an immutable DICOM SHA-256 trauma audit log.
Feel free to explore the repository, test the live simulator on desktop or mobile, and share your feedback!
