Coupling Four AI Models to Deliver the Ultimate Experience in Immersive Visualization and Modeling

Read on about how this new free app called HandMol achieves immersive, collaborative visualization and modeling of molecular structures by integrating 6 modern computer technologies -all in the web and multi-device

LucianoSphere (Luciano Abriata, PhD)
Towards AI
Published in
21 min readDec 1, 2023

--

HandMol integrates WebXR, AI-powered hand tracking native to the VR headset, AI-powered speech recognition assisted by an AI large language model, AI-based molecular mechanics, and WebRTC to allow immersive two-user interaction in molecular graphics and modeling. Figure composed by the author from snapshots taken in his own software.

--

--

https://www.lucianoabriata.com | Scientific writing, technology integrator, programming, biotech, bioinformatics.| Have a job for me? Contact me in ES FR EN IT