Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro
Traditional 3D content creation paradigms present significant barriers to meaningful creative expression in XR environments, limiting designers' ability to iterate fluidly between conceptual thinking and spatial implementation. Current tools often disconnect the designer's creative thought...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-07-01
|
| Series: | Frontiers in Computer Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fcomp.2025.1591289/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1839612677387714560 |
|---|---|
| author | Jie Fu Mick Grierson Renpeng Jiang Shun Fu Mengzhi He Muhan Xu |
| author_facet | Jie Fu Mick Grierson Renpeng Jiang Shun Fu Mengzhi He Muhan Xu |
| author_sort | Jie Fu |
| collection | DOAJ |
| description | Traditional 3D content creation paradigms present significant barriers to meaningful creative expression in XR environments, limiting designers' ability to iterate fluidly between conceptual thinking and spatial implementation. Current tools often disconnect the designer's creative thought process from the immersive context where their work will be experienced, creating a gap between design intention and spatial realization. This disconnect particularly impacts the iterative cycles fundamental to effective design thinking, where creators need to rapidly externalize, test, and refine concepts within their intended spatial context. This research addresses the need for more intuitive, context-aware creation systems that support the iterative nature of creative cognition in immersive environments. We developed Dream Space, a spatial computing system that bridges this gap by enabling designers to think, create, and iterate directly within XR contexts. The system leverages generative AI for rapid prototyping of 3D content and environments, allowing designers to externalize and test creative concepts without breaking their cognitive flow. Through multimodal interaction design utilizing Vision Pro's spatial computing capabilities, creators can manipulate virtual artifacts through natural gestures and gaze, supporting the fluid iteration cycles characteristic of established design thinking frameworks. A mixed-methods evaluation with 20 participants from diverse creative backgrounds demonstrated that spatial computing-based creation paradigms significantly reduce cognitive load in the design process. The system enabled even novice users to complete complex creative tasks within 20-30 minutes, with real-time feedback mechanisms supporting rapid iteration between ideation and implementation. Participants reported enhanced creative flow and reduced technical barriers compared to traditional 3D creation tools. This research contributes to understanding how XR interfaces can better support creative cognition and iterative design processes, offering insights for developing tools that enhance rather than hinder the natural flow of creative thinking in immersive environments. |
| format | Article |
| id | doaj-art-d7903f860c4449df9a0f4539cc3e2a2d |
| institution | Matheson Library |
| issn | 2624-9898 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Computer Science |
| spelling | doaj-art-d7903f860c4449df9a0f4539cc3e2a2d2025-07-28T05:30:46ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982025-07-01710.3389/fcomp.2025.15912891591289Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision ProJie Fu0Mick Grierson1Renpeng Jiang2Shun Fu3Mengzhi He4Muhan Xu5Creative Computing Institute, University of the Arts London, London, United KingdomCreative Computing Institute, University of the Arts London, London, United KingdomDian Jiang Technology Co., LTD, Tianjin, ChinaBloks Technology Company, Shanghai, ChinaCreative Computing Institute, University of the Arts London, London, United KingdomCreative Computing Institute, University of the Arts London, London, United KingdomTraditional 3D content creation paradigms present significant barriers to meaningful creative expression in XR environments, limiting designers' ability to iterate fluidly between conceptual thinking and spatial implementation. Current tools often disconnect the designer's creative thought process from the immersive context where their work will be experienced, creating a gap between design intention and spatial realization. This disconnect particularly impacts the iterative cycles fundamental to effective design thinking, where creators need to rapidly externalize, test, and refine concepts within their intended spatial context. This research addresses the need for more intuitive, context-aware creation systems that support the iterative nature of creative cognition in immersive environments. We developed Dream Space, a spatial computing system that bridges this gap by enabling designers to think, create, and iterate directly within XR contexts. The system leverages generative AI for rapid prototyping of 3D content and environments, allowing designers to externalize and test creative concepts without breaking their cognitive flow. Through multimodal interaction design utilizing Vision Pro's spatial computing capabilities, creators can manipulate virtual artifacts through natural gestures and gaze, supporting the fluid iteration cycles characteristic of established design thinking frameworks. A mixed-methods evaluation with 20 participants from diverse creative backgrounds demonstrated that spatial computing-based creation paradigms significantly reduce cognitive load in the design process. The system enabled even novice users to complete complex creative tasks within 20-30 minutes, with real-time feedback mechanisms supporting rapid iteration between ideation and implementation. Participants reported enhanced creative flow and reduced technical barriers compared to traditional 3D creation tools. This research contributes to understanding how XR interfaces can better support creative cognition and iterative design processes, offering insights for developing tools that enhance rather than hinder the natural flow of creative thinking in immersive environments.https://www.frontiersin.org/articles/10.3389/fcomp.2025.1591289/full3D content creationimmersive environment generationApple Vision Proextended realitymultimodal interactionspatial computing |
| spellingShingle | Jie Fu Mick Grierson Renpeng Jiang Shun Fu Mengzhi He Muhan Xu Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro Frontiers in Computer Science 3D content creation immersive environment generation Apple Vision Pro extended reality multimodal interaction spatial computing |
| title | Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro |
| title_full | Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro |
| title_fullStr | Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro |
| title_full_unstemmed | Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro |
| title_short | Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro |
| title_sort | interface design and interaction optimization for spatial computing 3d content creation and immersive environment generation using apple vision pro |
| topic | 3D content creation immersive environment generation Apple Vision Pro extended reality multimodal interaction spatial computing |
| url | https://www.frontiersin.org/articles/10.3389/fcomp.2025.1591289/full |
| work_keys_str_mv | AT jiefu interfacedesignandinteractionoptimizationforspatialcomputing3dcontentcreationandimmersiveenvironmentgenerationusingapplevisionpro AT mickgrierson interfacedesignandinteractionoptimizationforspatialcomputing3dcontentcreationandimmersiveenvironmentgenerationusingapplevisionpro AT renpengjiang interfacedesignandinteractionoptimizationforspatialcomputing3dcontentcreationandimmersiveenvironmentgenerationusingapplevisionpro AT shunfu interfacedesignandinteractionoptimizationforspatialcomputing3dcontentcreationandimmersiveenvironmentgenerationusingapplevisionpro AT mengzhihe interfacedesignandinteractionoptimizationforspatialcomputing3dcontentcreationandimmersiveenvironmentgenerationusingapplevisionpro AT muhanxu interfacedesignandinteractionoptimizationforspatialcomputing3dcontentcreationandimmersiveenvironmentgenerationusingapplevisionpro |