Continue to Site

Welcome to EDAboard.com

Welcome to our site! EDAboard.com is an international Electronics Discussion Forum focused on EDA software, circuits, schematics, books, theory, papers, asic, pld, 8051, DSP, Network, RF, Analog Design, PCB, Service Manuals... and a whole lot more! To participate you need to register. Registration is free. Click here to register now.

Options for contactless rotary knob gesture recognition

Georgy.Moshkin

Full Member level 5
Full Member level 5
Joined
Oct 9, 2017
Messages
253
Helped
44
Reputation
88
Reaction score
34
Trophy points
28
Activity points
2,351
For my projects I need a touchless rotary knob gesture sensor. Idea is to tune value using pointing finger clockwise/counterclockwise movements about 3cm from the sensor while observing feedback on a small screen (digital value / computer graphics generated rotated knob image). And the second wearable project requires the same without visual feedback but with size and power consumption constraints. Currently I am testing IR based gesture sensors, but they do not include recognition functionality or only include very simplistic algorithm. From my perspective IR gesture sensors provide enough data to accomplish this task and I recorded a lot of gesture waveforms and developed pretty good algorithms for APDS9960, but maybe there is a better solution. Camera algorithms seems attractive, but probably will require much more processing power and would not work in low light conditions. There are also electromagnetic based sensors, but I haven't found a single video demonstrating good reaction to small amplitude movements.
To sum up, what I am trying to find / achieve is:
1) touchless recognition of pointing finger rotary gestures
2) small amplitude finger movements
3) realtime data on current angular position (rotation direction, speed) ~20fps
4) works in low-light conditions
5) low price, but may be up to 100 USD for something very robust and small (can fit in earphone-like enclosure)
 

BradtheRad

Super Moderator
Staff member
Advanced Member level 7
Joined
Apr 1, 2011
Messages
14,806
Helped
2,878
Reputation
5,768
Reaction score
2,901
Trophy points
1,393
Location
Minneapolis, Minnesota, USA
Activity points
110,642
3 cm is suitable distance for a neodymium magnet to influence a compass. Attach a magnet to your fingernail with sticky gum. By moving your finger near the compass you spin it any way you wish.

The compass needs to be damped somehow, though not too much. Or perhaps fabricate something resembling a clock hand pivoting around at the center, while a magnet attached to the free end follows your finger magnet.

Led sensors or hall sensors, etc., are detection methods.
 

Georgy.Moshkin

Full Member level 5
Full Member level 5
Joined
Oct 9, 2017
Messages
253
Helped
44
Reputation
88
Reaction score
34
Trophy points
28
Activity points
2,351
Thanks for an idea. For a commercial product, there must be some kind of wearable thimble with a magnet, the thing I want to avoid. IR led sensor I've tested have 4 photoelements that are relatively well matched and have some optics that results in readings as if those elements was placed further apart (I think). There is similar sensor called PAJ7620 which includes simple recognition algorithms for clockwise and counter-clockwise recognition, but does not provide data before recognition.
 

BradtheRad

Super Moderator
Staff member
Advanced Member level 7
Joined
Apr 1, 2011
Messages
14,806
Helped
2,878
Reputation
5,768
Reaction score
2,901
Trophy points
1,393
Location
Minneapolis, Minnesota, USA
Activity points
110,642
1.
There's the principle of the theremin... a musical instrument controlled by the operator's hands moving near proximity sensors (one to change pitch, another to change volume).
Probably three proximity sensors are sufficient to triangulate a finger's position and motion.

2.
Three opto-sensors detect a fingertip's position and motion. It's illuminated uniformly from below by an array of led's or bulbs. The finger needs to be bright enough, and in view of all 3 sensors, in order to triangulate its position.
 

barry

Advanced Member level 7
Advanced Member level 7
Joined
Mar 31, 2005
Messages
6,068
Helped
1,178
Reputation
2,368
Reaction score
1,340
Trophy points
1,393
Location
California, USA
Activity points
33,007
A Theremin uses the capacitance of your hand to de-tune an RF circuit. I'm not sure how you can detect two-dimensional motion of a finger using that technology. Problems of RF leakage, etc. sound too daunting to me. Optical might be a more practical approach.
 

Georgy.Moshkin

Full Member level 5
Full Member level 5
Joined
Oct 9, 2017
Messages
253
Helped
44
Reputation
88
Reaction score
34
Trophy points
28
Activity points
2,351
A Theremin uses the capacitance of your hand to de-tune an RF circuit. I'm not sure how you can detect two-dimensional motion of a finger using that technology. Problems of RF leakage, etc. sound too daunting to me. Optical might be a more practical approach.
Yes, I'll probably focus on commercial IR based sensor.
How do you think, is there a demand for a robust gesture sensing module with recognition? I have achieved some pretty good results, but always wanted to find a better solution. Now I think that what I already made may be the best thing on the market. I am thinking of creating small recognition module with configurable outputs, which provides classic up/down/left/right gestures, and much more information, such as speed, angular position, fine tuning. Control of different things using touchless gestures, maybe passwords. I think it may be applied in many areas, from hobby and music, to laboratory and industrial equipment. I really hope I can start selling this stuff, self-fund my bigger project, and start work for myself.
 

Georgy.Moshkin

Full Member level 5
Full Member level 5
Joined
Oct 9, 2017
Messages
253
Helped
44
Reputation
88
Reaction score
34
Trophy points
28
Activity points
2,351
Here are my current results using APDS9960
I aimed for more, but there are some hardware sensing area constraints that difficult to overcome algorithmically without adding more sensors. It may be used for robotics, especially robotic toys, by DIYers and entertainment. My next step is to add two more sensors and process data simultaneously to add very nice proximity features. For best user experience gesture sensor must be as responsive and reliable as physical rotary button or switch.
 

LaTeX Commands Quick-Menu:

Part and Inventory Search

Welcome to EDABoard.com

Sponsor

Top