Products
XR Skeleton
A high-end full skeleton gesture software that tracks 21 points on each hand in 3 dimensions with measured distances between each point. XR Skeleton targets high-end AR glasses and VR devices and support a variety of camera settings including single RGB, stereo RGB/B&W and infrared sensors. The software enables unlimited interaction possibilities with virtual objects including capability of detecting a large variety of hand poses.
PS Skeleton
A high-end skeleton detection and tracking software that is capable of tracking hands and soon body in 3 dimensions. PS Skeleton support RGB cameras as well as Infrared sensors and targets primarily Automotive-related use cases such as Driver Monitoring Systems, Occupant Monitoring Systems and infotainment screen interaction.
XR Tracking
Designed to provide an interaction experience for mid-end hardware with capability to mimic traditional PC/laptop interaction with mouse pointer and click-events. The software uses a camera sensor to track the hand and detect a set of pre-defined poses that can trigger commands in the device. The software can replace other interaction methods including physical buttons and touch display by enabling e.g., a flexible pinch-to-select gesture.
XR Pose
Optimised to detect hand poses and trigger commands in more limited hardware like AR smart glasses with a monocular display. Poses include eg. open/closed hand, swipe and thumbs-up.
Selfie AR
Developed for front facing camera mode – all gestures are detected with the camera pointing towards the user. The software is mainly used in smartphones and tablets for photo capture from a distance but also to add effects in MobileAR features.
Technology
Crunchfish delivers high performance hand- and body tracking technologies that enable gesture interaction and other use cases in wearables (AR/VR), smartphones and automotive. Our technologies are the result of over 10 years of research in Artificial Intelligence, Machine Learning and Computer Vision.
We design and train our models with in-house optimized neural networks and tools to provide state-of-the-art technology and solutions.
Technical benefits
Accurate
Leading performance with hand recognition rate of up to 98% and extremely responsive tracking.
Efficient
Low latency and battery consumption with proprietary computer vision and machine learning techniques.
Easy to integrate
Crunchfish’s solutions are platform agnostic and easy to integrate into existing hardware.
Customizable
A library of gesture poses and APIs that enables customized solutions for a variety of use cases and business verticals.
Hardware compatibility
Crunchfish’s gesture interaction products are generic and compatible with many different hardware products.
Compatible product hardware
AR/VR headsets
Automotive
Robots
Smartphones
Tablets
Smart displays
Compatible camera sensors
RGB
Monochrome
RGB Stereo
Infrared (IR)
Fisheye
Monochrome Stereo
Software compatibility
It is possible to run Crunchfish’s software on almost any software platform, but may require adaptation in some cases.
Compatible software
Android
Unix/Linux
Unity
ARCore
iOS
Performance
Latency
<20ms
Frame processing time of Crunchfish’s software on reference platform.
Gesture recognition rate
Up to 98% on pose trigger and gesture sequence
At what rate Crunchfish’s software recognizes a certain gesture.
Load on reference CPU
<14%
Crunchfish’s technology is capable of running on GPU and NPU, which if available will affect runtime and load substantially.
Distance
Up to 5 meters or 16ft
Distance between object and camera sensor subject to sensor type.
Try our demo
This application demonstrates Crunchfish’s XR Tracking solution designed for efficient touchless interaction with any standard AR smart glasses and/or mobile devices running Android 5.0 or later. Using the pinch, interaction such as navigation, item selection, annotation and zooming can be performed.
Please contact us also for evaluation of Crunchfish XR/PS Skeleton.