The principle is as follows:
HoloLamp uses the Unity engine, but instead of rendering 3D objects when actually projected, the image is distorted to give the screen a 3D image. At the same time, users can manipulate the screen objects through the PlayStation 4 controller.
The system uses a face-tracking camera that recognizes the direction of gaze and adjusts the projection to the user's movements, allowing the user to "mistake" a 2D image for a real 3D object.
What it achieves:
Usually, we'd need an AR device like HoloLens to display an augmented reality image, but the HoloLamp, which was on display at CES 2017, is a hands-free, lens-free augmented reality device. With HoloLamp, users can interact with their surroundings, making it an ideal AR solution for many business and personal environments.
In addition to providing augmented reality effects, HoloLamp can use real physical devices to create interesting interactions, such as projecting game-specific animations on a table. The R&D team says HoloLamp is also suitable for displaying historical artifacts. The technology is also expected to render 3D avatars of real people in the future, making distance learning and healthcare more realistic and vivid.