VideoMap
Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space
2024

VideoMap is a proof-of-concept video editing interface that operates on video frames projected onto a latent space, enabling users to visually uncover patterns and relationships. We introduce map-inspired navigational elements (node, path, district, landmark) to support users in navigating the map.
Video editing is a creative and complex endeavor and we believe that there is potential for reimagining a new video editing interface to better support the creative and exploratory nature of video editing. We take inspiration from latent space exploration tools that help users find patterns and connections within complex datasets. We present VideoMap, a proof-of-concept video editing interface that operates on video frames projected onto a latent space. We support intuitive navigation through map-inspired navigational elements and facilitate transitioning between different latent spaces through swappable lenses. We built three VideoMap components to support editors in three common video tasks. In a user study with both professionals and non-professionals, editors found that VideoMap helps reduce grunt work, offers a user-friendly experience, provides an inspirational way of editing, and effectively supports the exploratory nature of video editing. We further demonstrate the versatility of VideoMap by implementing three extended applications.
VideoMap overview
For more information, see the paper: VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space (pdf)
Researchers
Nikolas Martelaro, David Chuan-en Lin ,
Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang (Adobe Research)
Research Areas
Applied Machine Learning, Human-Centered AI, Tools