Charlie Gerard • 1/20/2022

Building UIs in Figma with hand movements

Read Original

This technical article details the creation of a Figma plugin prototype that uses the MediaPipe handpose detection model via TensorFlow.js to control UI design with hand gestures. It explains the architecture, including overcoming Figma plugin limitations by using a separate web app with Socket.io for data transfer, and provides code samples for detecting specific gestures like a 'zoom' command.

0 comments
#Machine Learning #ui-design #Tensorflowjs
Building UIs in Figma with hand movements

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser

Top of the Week

1
Webinar Series – SQL Server Indexing
Koen Verbeeck • 1 votes
2
Risks and Limitations of AI in the Life Sciences
Jeremy Howard • 1 votes
3
1M context is now generally available for Opus 4.6 and Sonnet 4.6
Simon Willison • 1 votes
4
AI is my CMS
Chris Coyier • 1 votes
5
When your coding agent doesn’t understand your project, you’ll get junk
Benjamin Cane • 1 votes
6
LLM Use in the Python Source Code
Miguel Grinberg • 1 votes