Gestures Transform Urban Landscapes into Artistic Expressions Flowing

The primary challenge was creating an intuitive and engaging interface that would allow participants to seamlessly interact with complex AI-generated artistic styles. We needed to develop a system that could translate hand movements into artistic brushstrokes while maintaining the distinctive characteristics of each artistic style.

Additionally, we had to ensure the interaction felt natural and accessible to participants with no prior artistic experience, while still providing enough creative control to produce meaningful results.

Our approach focused on creating an experience that mimicked traditional painting processes while leveraging advanced technology. We designed a physical color palette interface with style-specific markers, making the style selection process familiar and intuitive, similar to choosing colors from a traditional palette.

The strategy emphasized making the technology invisible to users, allowing them to focus on the creative process rather than the technical aspects of the installation.

The installation integrates several key components to create a seamless interactive experience:

• A large-scale projection system for displaying the artwork
• LIDAR technology to track hand movements and translate them into digital brushstrokes
• A physical palette interface with RFID sensors for style selection
• Pre-generated AI style transfers of Taipei street scenes
• Real-time rendering system that combines hand tracking with style transfers
• Custom-designed interface elements that provide clear visual feedback for user actions

The installation successfully created an engaging platform for public interaction with urban art and AI technology. Participants embraced the opportunity to reimagine familiar cityscapes through different artistic lenses, creating unique interpretations of Taipei’s urban environment.

The intuitive interface allowed people of all skill levels to participate meaningfully in the creative process, while the focus on local imagery helped strengthen connections between historical artistic styles and contemporary urban life.

“Style Brushworks” demonstrates the potential for technology to make artistic expression more accessible while maintaining meaningful creative control. The project reveals how familiar physical interfaces can bridge the gap between traditional artistic processes and digital creation, making complex technology approachable for general audiences.

Furthermore, the focus on local imagery proves valuable in creating personal connections between participants and the artwork, suggesting that localization can significantly enhance engagement with interactive art installations.