ML2: Object Oriented Hand Classifier Recognition with LEAP and Unity

ID: 3499
Status: Ongoing
Start date: February 2017


We are investigating sign recognition interfaces to utilize interactivity in learning. LEAP Motion is a motion sensor system that tracks the hands and implements in 3D environments. Our goal is to utilize LEAP Motion to identify parameters of different ASL handshapes that are object-specific classifiers. The purpose of this project is to create an immersive game experience, where young deaf learners will learn the correct handshapes and movements to guide the object. Through this project, we want to understand the integration of LEAP Motion and Unity (game engine) to better define sign/movement recognition that can contribute to language learning programs.

Principal investigators

Additional investigators

Priorities addressed

Funding sources