Interview about Mukden Palace Experience Mixed Reality Interface, winner of the A' Interface, Interaction and User Experience Design Award 2024
Unlike modern museums, which are typically built with innovative digital interactive experiences, those located within cultural landmarks and heritage sites often face a common challenge: the lack of digital experiences. By designing the Mixed Reality interface in the Apple VisionPro, The Palace Museum Interactive Experience, represents a pioneering approach by introducing new ways to display exhibits in heritage museums. This method not only balances preserving cultural artifacts with digital interaction but also sets a pioneering example for heritage museums worldwide.
View detailed images, specifications, and award details on A' Design Award & Competition website.
View Design DetailsOur design philosophy was guided by three key principles: preserving cultural authenticity, prioritizing user immersion, and leveraging cutting-edge technology responsibly. We aimed to enhance visitors' understanding of heritage artifacts without overshadowing their original essence. This balance was achieved by integrating subtle yet powerful mixed-reality interactions that feel natural and intuitive. We also emphasized inclusivity, ensuring the experience would resonate with audiences of diverse ages and cultural backgrounds.
Through field observations and interviews, we discovered that visitors often felt disconnected from static displays, finding them insufficiently engaging. Surveys revealed a demand for more dynamic storytelling and interactive exhibits akin to modern science museums. However, our analysis also highlighted the fear that such technologies might overshadow or distort cultural authenticity. This insight led us to design an experience that harmonizes digital interaction with historical preservation.
My experience with automotive interfaces, particularly in designing for augmented reality head-up displays, provided valuable insights into creating intuitive gesture and eye-tracking controls. In both contexts, users require seamless interaction without cognitive overload. Applying these principles, we prioritized simplicity and clarity, ensuring that gestures such as grabbing and zooming felt natural and aligned with visitors' expectations.
One major challenge was adhering to Apple Vision Pro's strict design guidelines while ensuring the interface complemented the historical aesthetic of Mukden Palace. For example, the color palette and typography needed to reflect the cultural context while maintaining legibility and accessibility. Additionally, ensuring precise eye-tracking and gesture recognition in a museum environment with varying lighting conditions required extensive usability testing and calibration.
These dimensions and typography choices ensure users can interact confidently without errors, especially in a mixed-reality environment where precise actions are critical. The SF Pro font, paired with appropriate weights, helps create a clear visual hierarchy, enabling visitors to focus on key content effortlessly. Such thoughtful details enhance both usability and engagement, making the experience seamless and enjoyable.
Growing up near Mukden Palace, I was deeply inspired by its historical significance. However, I realized many visitors struggled to connect with its rich stories through static displays. This motivated me to bring the past to life using modern technology. In the future, I envision this technology expanding to other heritage sites, enabling global audiences to experience history more intimately and interactively.
We started by studying each artifact's cultural and historical context through archival research and expert consultations. Then, we collaborated with historians and digital artists to recreate 3D models. The digital representations retained fine details while adding interactivity, such as annotations and layered information. This approach ensured an authentic yet engaging experience.
Collaborating across the U.S. and China exposed us to diverse cultural perspectives and technological insights. This broadened our understanding of how global audiences engage with heritage. We incorporated inclusive design principles, such as multilingual support and adaptable features, ensuring accessibility for users from various backgrounds.
Early testers expressed amazement at how the interface allowed them to see artifacts "come alive" but requested more context for their historical significance. This feedback led us to enrich the app with layered storytelling, combining text, videos, and augmented visuals to enhance both understanding and immersion.
I envision this technology bridging the gap between past and present, offering an unprecedented level of engagement. Visitors will no longer passively observe but actively participate in history through dynamic interactions. Moreover, this model could set new standards for cultural preservation, demonstrating how technology can coexist harmoniously with heritage.
Dive into a world of design excellence with our curated highlights. Each feature showcases outstanding creativity, innovation, and impact from the design world. Discover inspiration and learn more about these incredible achievements.
