Follow us
Home > News > Content
3D Gesture Control In The Internet Of Things
Jul 23, 2017


The Internet of things (IoT) devices not only illustrate the latest communications technology and cloud connectivity, but also redefine older products, such as light switches, that have been around for more than a century.With IoT, developers tend to add far more new features than they could imagine a few years ago.Now, for example, as long as a light switch can turn off all the lights in the home, when preparing to sleep adjust any home a lamp light color and brightness, set lighting solution in the automatic execution order, and whether at home or can be fixed by the smartphone to remote control it.

However, IoT devices are also embedded products, which means that users can operate and control them without having to read the manual in advance.

Challenges and opportunities

The user interface (UI) triggered by IoT is a key factor that brings many benefits (but not limited to connectivity) to users.Customers are increasingly looking for UI, especially for embedded devices, which also limit power consumption, small size and low cost.It is a challenge to meet users' expectations to develop a fashion UI that has these embedded requirements, but coping with this challenge is also a key factor in determining the success of a product.What will the 21st century light switch look like?How do we make the most of IoT, not just the basic concept of connecting everything?

Gestures or meaningful hand movements are basic communication methods that humans have been using since the beginning of time and are part of our daily lives.We just wave up to "turn on the light" and simply rotate clockwise to "turn on the light".Dimming or turning off lights doesn't require much explanation.The gesture based user interface is very intuitive.Applying gestures to control will lead to a series of improvements in consumer usability and industrial design that can be achieved within the project budget.

Using the electric field

The Microchip mgc3030/3130 gesture controller provides real single-chip gesture detection, which can be implemented.The controller based on Microchip GestIC ? patented technology and design, by the movements of the electric field to detect people hand area of the body (see figure 1 and figure 2).

Figure 1: GestIC ? technology use electric field to detect hand movements

Figure 2: gestures can be detected when a hand action interferes with an electric field

Because of the capacitive sensing technology, the system does not require any lighting, and the implementation of this operation does not require a lens or opening.For example, using a seamless integrated gesture detection board, the light switch can have a smooth surface;It can even be hidden behind the drywall, blending into the interior design of the room without damage.The gesture controller is designed for the purpose of embedded application, which can be automatically calibrated for environmental changes and equipped with the gesture detection function.This technique requires no mainframe computation and is equipped with automatic wakeup/dormancy.The latter is not only a key factor to meet the low power consumption requirements of the system, but also is crucial for use cases.The automatic wake-up function provides 24/7 gesture detection, and the ever-working user interface meets our expectations of the light switch.When your hand is close to the light switch, the auto-wake function will be triggered, lighting up the area ahead of your control switch.People often use light switches in the dark, so this is a very useful feature.

2.jpgElectric fields can be generated using any conductive material, including printed circuit board (PCB), to realize the sensing function.Built-in analog front end and the 32-bit kernel running in the firmware, can be sensed by the user of hand move for any electric field changes and related processing, so as to identify the corresponding gestures and provide the users hand X - Y - Z coordinate information.This built-in simulation and digital noise filter basically guarantees the reliability of gesture detection.Even a dynamic, changing environment does not affect the system.

All controller products in this series are connected to an optional host through I2C.The gesture information is then sent to the host, with this simple topology (see figure 3) that the controller can be quickly integrated to any set.

Figure 3: using MGC3030 3 d gesture controller GestIC ? topology

In addition, they minimize the need for mainframes, and gesture ports support non-host use.With this gesture-port feature, specific gestures can be easily mapped to configurable input/output interfaces.In this way, software development is not required in the product development process, so the user interface based on the gesture can be realized, which can greatly accelerate the listing of products.

The design of GestIC technology is accomplished through the GUI, which can be customized, the corresponding gestures are selected, and the relevant Settings and sequence information are passed to the application.

Microchip's gesture controller can provide a range of powerful features, including 3D gestures and touch and near-detection.According to x-y-z coordinate information, the function of free space movement can be increased in real time.

Figure 4: MGC3030 3D gesture controller



GestIC technology supports diverse, powerful gestures.The advantages of this type of UI are reflected in various home automation applications, including but not limited to indoor lighting, audio, heating, air conditioning, Windows, blinds, and sun protection systems.And the ability to detect random gestures has successfully carried out the operation of answering/rejecting calls, effectively reducing the distracted driving time.A simple hand motion will allow the wireless speaker to play the next track, and a rotation will adjust the volume.When people can choose to implement in the form of no contact with any object toilet flush operation, we will only know induction of embedded gestures Generation really arrived (on which the water sensor is only able to detect the movement rather than precise action).