SASAV: Self-Directed Agent for Scientific Analysis and Visualization

IEEE VIS 2026
Paper Supplementary Code
In this work, we propose a Self-Directed Agent for Scientific Analysis and Visualization (SASAV), the first fully autonomous AI agent to perform scientific data analysis and generate insightful visualizations without any external prompting or human-in-the-loop feedback.

Abstract

With recent advances in frontier multimodal large language models (MLLMs) for data understanding and visual reasoning, the role of LLMs has evolved from passive LLM-as-an-interface to proactive LLM-as-a-judge, enabling deeper integration into the scientific data analysis and visualization pipelines. However, existing scientific visualization agents still rely on domain experts to provide prior knowledge for specific datasets or visualization-oriented objective functions to guide the workflow through iterative feedback. This reactive, data-dependent, human-in-the-loop (HITL) paradigm is time-consuming and does not scale effectively to large-scale scientific data. In this work, we propose a Self-Directed Agent for Scientific Analysis and Visualization (SASAV), the first fully autonomous AI agent to perform scientific data analysis and generate insightful visualizations without any external prompting or HITL feedback. SASAV is a multi-agent system that automatically orchestrates data exploration workflows through our proposed components, including automated data profiling, context-aware knowledge retrieval, and reasoning-driven visualization parameter exploration, while supporting downstream interactive visualization tasks. This work establishes a foundational building block for the future AI for Science to accelerate scientific discovery and innovation at scale.

Case Studies

Five representative scientific volumetric datasets highlight the usability of SASAV.

Abdomen

The Abdomen is one scan from AbdomenAtlas 1.1 Mini Dataset, which is a fully-annotated abdominal CT dataset to date, including 9,262 CT volumes with annotations for 25 different anatomical structures.

Chameleon

The Chameleon dataset is a CT scan of a chameleon.

Miranda

The Miranda is a time step of a density field in a simulation of the mixing transition in Rayleigh-Taylor instability.

Flame

The Flame dataset is a simulated combustion 3D scalar field.

Richtmyer

The Richtmyer dataset is the entropy field (timestep 160) of Richtmyer-Meshkov instability simulation.

Agentic Workflow

SASAV consists of four steps: 1) Data profiling 2) Knowledge retrieval 3) Transfer functions suggestion 4) View selection

Wide Visualization Result

User Interface

SASAV has a intuitive and minimal user interface, user only needs a API key of their choice of LLM to run SASAV for generating visualize their own scientific data with ease.

SASAV User Interface

Demonstration

Please refer to the supplimentary video submitted together with the paper for SASAV running demonstration.

User Feedback

A study with three researchers in scientific data analysis and visualization.

Key Advantages

  • This system is highly effective in reducing manual effort in volume rendering.
  • The automatic visualization parameter searching can save a lot of time, especially when the dataset is large.
  • Scientists rely less on technical knowledge to explore their data, which can help speed up analysis time.

Future Improvement

  • SASAV has strong potential to evolve into a more closed-loop framework by incorporating additional agents for downstream tasks that evaluate and refine the visualization results.
  • Introducing more visualization techniques for more types of data, for example, point clouds and time-varying data.
  • Supporting collaboration by offering additional perspectives on the shared research problem.