Image and video data analysis has become an increasingly important research area with applications in different domains such as security surveillance, healthcare, augmented and virtual reality, video and image editing, activity analysis and recognition, synthetic content generation, distance education, telepresence, remote sensing, sports analytics, art, non-photorealistic rendering, search engines, and social media. Recent advances in Artificial Intelligence (AI) and particularly deep learning have sparked new research challenges and led to significant advancements, especially in image and video analysis. These advancements have also resulted in significant research and development in other areas such as visualization and visual analytics, and have created new opportunities for future lines of research. In this survey article, we present the current state of the art at the intersection of visualization and visual analytics, and image and video data analysis. We categorize the visualization articles included in our survey based on different taxonomies used in visualization and visual analytics research. We review these articles in terms of task requirements, tools, datasets, and application areas. We also discuss insights based on our survey results, trends and patterns, the current focus of visualization research, and opportunities for future research.
Original languageEnglish (US)
Pages (from-to)1-41
Number of pages41
JournalACM Transactions on Interactive Intelligent Systems
Issue number1
StatePublished - Mar 9 2023

Bibliographical note

KAUST Repository Item: Exported on 2023-04-10
Acknowledged KAUST grant number(s): REP/1/3268-01-01
Acknowledgements: This study was supported by the Office of Sponsored Research (OSR) at King Abdullah University of Science and Technology (KAUST) under the “Virtual Red Sea Initiative” (award #REP/1/3268-01-01). We also thank the KAUST Visualization Core Lab for their help and support.

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Artificial Intelligence


Dive into the research topics of 'Visualization and Visual Analytics Approaches for Image and Video Datasets: A Survey'. Together they form a unique fingerprint.

Cite this