Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations

Bridger Herman; Francesca Samsel; Annie Bares; Seth Johnson; Greg Abram; Daniel F. Keefe

doi:10.1109/VISAP51628.2020.00009

Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations

Bridger Herman, Francesca Samsel, Annie Bares, Seth Johnson, Greg Abram, Daniel F. Keefe

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Scopus citations

Abstract

We, as a society, need artists to help us interpret and explain science, but what does an artist's studio look like when today's science is built upon the language of large, increasingly complex data? This paper presents a data visualization design interface that lifts the barriers for artists to engage with actively studied, 3D multivariate datasets. To accomplish this, the interface must weave together the need for creative artistic processes and the challenging constraints of real-time, data-driven 3D computer graphics. The result is an interface for a technical process, but technical in the way artistic printmaking is technical, not in the sense of computer scripting and programming. Using metaphor, computer graphics algorithms and shader program parameters are reimagined as tools in an artist's printmaking studio. These artistic metaphors and language are merged with a puzzle-piece approach to visual programming and matching iconography. Finally, artists access the interface using a web browser, making it possible to design immersive multivariate data visualizations that can be displayed in VR and AR environments using familiar drawing tablets and touch screens. We report on insights from the interdisciplinary design of the interface and early feedback from artists.

Original language	English (US)
Title of host publication	Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020
Editors	Erik Brunvand, Yoon Chung Han, Carmen Hull, Maria Lantin
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	19-28
Number of pages	10
ISBN (Electronic)	9781728185538
DOIs	https://doi.org/10.1109/VISAP51628.2020.00009
State	Published - Oct 2020
Event	2020 IEEE VIS Arts Program, VISAP 2020 - Virtual, Salt Lake City, United States Duration: Oct 27 2020 → Oct 29 2020

Publication series

Name	Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020

Conference

Conference	2020 IEEE VIS Arts Program, VISAP 2020
Country/Territory	United States
City	Virtual, Salt Lake City
Period	10/27/20 → 10/29/20

Bibliographical note

Funding Information:
This research was supported in part by the National Science Foundation (IIS-1704604 & IIS-1704904). MPAS-Oceansimulations were conducted by Mark Petersen, Phillip Wolfram,Mathew Maltrud and Xylar Asay-Davis as part of the Energy Exascale Earth System Model (E3SM) project, funded by the U.S. Department of Energy (DOE), Office of Science, Office of Biological and EnvironmentalResearch with analyses conducted by PJW, MEM, and RXB under ARPA-E Funding Opportunity No. DE-FOA-0001726.E3SM simulations are conducted at Argonne Leadership Computing Facility (contract DE-AC02-06CH11357)National; Energy Research Scientific Computing Center(DE-AC05-00OR22725)Oak; RidgeLeadershipComputingFa-cility(DE-AC05-00OR22725)Ar; gonneNat. Lab. high-performance computing cluster, provided by BER Earth System Modeling; and Los AlamosNat. Lab. InstitutionalComputing,USDOENNSA(DE-AC52-06NA25396).The authors would also like to thank the artists who tried out the interface, and WingateStudio for providing the printmaking images.

Publisher Copyright:
© 2020 IEEE.

Keywords

Art and visualization
data visualization
user interfaces
visualization design

Access

10.1109/VISAP51628.2020.00009

OpenUrl availability

Full text

Cite this

Herman, B., Samsel, F., Bares, A., Johnson, S., Abram, G., & Keefe, D. F. (2020). Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations. In E. Brunvand, Y. C. Han, C. Hull, & M. Lantin (Eds.), Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020 (pp. 19-28). Article 9308002 (Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VISAP51628.2020.00009

Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations. / Herman, Bridger; Samsel, Francesca; Bares, Annie et al.
Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020. ed. / Erik Brunvand; Yoon Chung Han; Carmen Hull; Maria Lantin. Institute of Electrical and Electronics Engineers Inc., 2020. p. 19-28 9308002 (Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Herman, B, Samsel, F, Bares, A, Johnson, S, Abram, G & Keefe, DF 2020, Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations. in E Brunvand, YC Han, C Hull & M Lantin (eds), Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020., 9308002, Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020, Institute of Electrical and Electronics Engineers Inc., pp. 19-28, 2020 IEEE VIS Arts Program, VISAP 2020, Virtual, Salt Lake City, United States, 10/27/20. https://doi.org/10.1109/VISAP51628.2020.00009

Herman B, Samsel F, Bares A, Johnson S, Abram G, Keefe DF. Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations. In Brunvand E, Han YC, Hull C, Lantin M, editors, Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 19-28. 9308002. (Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020). doi: 10.1109/VISAP51628.2020.00009

Herman, Bridger ; Samsel, Francesca ; Bares, Annie et al. / Printmaking, Puzzles, and Studio Closets : Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations. Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020. editor / Erik Brunvand ; Yoon Chung Han ; Carmen Hull ; Maria Lantin. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 19-28 (Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020).

@inproceedings{adea4d20a7b94e3c90b2e4e5435eeefc,

title = "Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations",

abstract = "We, as a society, need artists to help us interpret and explain science, but what does an artist's studio look like when today's science is built upon the language of large, increasingly complex data? This paper presents a data visualization design interface that lifts the barriers for artists to engage with actively studied, 3D multivariate datasets. To accomplish this, the interface must weave together the need for creative artistic processes and the challenging constraints of real-time, data-driven 3D computer graphics. The result is an interface for a technical process, but technical in the way artistic printmaking is technical, not in the sense of computer scripting and programming. Using metaphor, computer graphics algorithms and shader program parameters are reimagined as tools in an artist's printmaking studio. These artistic metaphors and language are merged with a puzzle-piece approach to visual programming and matching iconography. Finally, artists access the interface using a web browser, making it possible to design immersive multivariate data visualizations that can be displayed in VR and AR environments using familiar drawing tablets and touch screens. We report on insights from the interdisciplinary design of the interface and early feedback from artists.",

keywords = "Art and visualization, data visualization, user interfaces, visualization design",

author = "Bridger Herman and Francesca Samsel and Annie Bares and Seth Johnson and Greg Abram and Keefe, {Daniel F.}",

note = "Funding Information: This research was supported in part by the National Science Foundation (IIS-1704604 & IIS-1704904). MPAS-Oceansimulations were conducted by Mark Petersen, Phillip Wolfram,Mathew Maltrud and Xylar Asay-Davis as part of the Energy Exascale Earth System Model (E3SM) project, funded by the U.S. Department of Energy (DOE), Office of Science, Office of Biological and EnvironmentalResearch with analyses conducted by PJW, MEM, and RXB under ARPA-E Funding Opportunity No. DE-FOA-0001726.E3SM simulations are conducted at Argonne Leadership Computing Facility (contract DE-AC02-06CH11357)National; Energy Research Scientific Computing Center(DE-AC05-00OR22725)Oak; RidgeLeadershipComputingFa-cility(DE-AC05-00OR22725)Ar; gonneNat. Lab. high-performance computing cluster, provided by BER Earth System Modeling; and Los AlamosNat. Lab. InstitutionalComputing,USDOENNSA(DE-AC52-06NA25396).The authors would also like to thank the artists who tried out the interface, and WingateStudio for providing the printmaking images. Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 IEEE VIS Arts Program, VISAP 2020 ; Conference date: 27-10-2020 Through 29-10-2020",

year = "2020",

month = oct,

doi = "10.1109/VISAP51628.2020.00009",

language = "English (US)",

series = "Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "19--28",

editor = "Erik Brunvand and Han, {Yoon Chung} and Carmen Hull and Maria Lantin",

booktitle = "Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020",

}

TY - GEN

T1 - Printmaking, Puzzles, and Studio Closets

T2 - 2020 IEEE VIS Arts Program, VISAP 2020

AU - Herman, Bridger

AU - Samsel, Francesca

AU - Bares, Annie

AU - Johnson, Seth

AU - Abram, Greg

AU - Keefe, Daniel F.

N1 - Funding Information: This research was supported in part by the National Science Foundation (IIS-1704604 & IIS-1704904). MPAS-Oceansimulations were conducted by Mark Petersen, Phillip Wolfram,Mathew Maltrud and Xylar Asay-Davis as part of the Energy Exascale Earth System Model (E3SM) project, funded by the U.S. Department of Energy (DOE), Office of Science, Office of Biological and EnvironmentalResearch with analyses conducted by PJW, MEM, and RXB under ARPA-E Funding Opportunity No. DE-FOA-0001726.E3SM simulations are conducted at Argonne Leadership Computing Facility (contract DE-AC02-06CH11357)National; Energy Research Scientific Computing Center(DE-AC05-00OR22725)Oak; RidgeLeadershipComputingFa-cility(DE-AC05-00OR22725)Ar; gonneNat. Lab. high-performance computing cluster, provided by BER Earth System Modeling; and Los AlamosNat. Lab. InstitutionalComputing,USDOENNSA(DE-AC52-06NA25396).The authors would also like to thank the artists who tried out the interface, and WingateStudio for providing the printmaking images. Publisher Copyright: © 2020 IEEE.

PY - 2020/10

Y1 - 2020/10

N2 - We, as a society, need artists to help us interpret and explain science, but what does an artist's studio look like when today's science is built upon the language of large, increasingly complex data? This paper presents a data visualization design interface that lifts the barriers for artists to engage with actively studied, 3D multivariate datasets. To accomplish this, the interface must weave together the need for creative artistic processes and the challenging constraints of real-time, data-driven 3D computer graphics. The result is an interface for a technical process, but technical in the way artistic printmaking is technical, not in the sense of computer scripting and programming. Using metaphor, computer graphics algorithms and shader program parameters are reimagined as tools in an artist's printmaking studio. These artistic metaphors and language are merged with a puzzle-piece approach to visual programming and matching iconography. Finally, artists access the interface using a web browser, making it possible to design immersive multivariate data visualizations that can be displayed in VR and AR environments using familiar drawing tablets and touch screens. We report on insights from the interdisciplinary design of the interface and early feedback from artists.

AB - We, as a society, need artists to help us interpret and explain science, but what does an artist's studio look like when today's science is built upon the language of large, increasingly complex data? This paper presents a data visualization design interface that lifts the barriers for artists to engage with actively studied, 3D multivariate datasets. To accomplish this, the interface must weave together the need for creative artistic processes and the challenging constraints of real-time, data-driven 3D computer graphics. The result is an interface for a technical process, but technical in the way artistic printmaking is technical, not in the sense of computer scripting and programming. Using metaphor, computer graphics algorithms and shader program parameters are reimagined as tools in an artist's printmaking studio. These artistic metaphors and language are merged with a puzzle-piece approach to visual programming and matching iconography. Finally, artists access the interface using a web browser, making it possible to design immersive multivariate data visualizations that can be displayed in VR and AR environments using familiar drawing tablets and touch screens. We report on insights from the interdisciplinary design of the interface and early feedback from artists.

KW - Art and visualization

KW - data visualization

KW - user interfaces

KW - visualization design

UR - http://www.scopus.com/inward/record.url?scp=85099733034&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85099733034&partnerID=8YFLogxK

U2 - 10.1109/VISAP51628.2020.00009

DO - 10.1109/VISAP51628.2020.00009

M3 - Conference contribution

AN - SCOPUS:85099733034

T3 - Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020

SP - 19

EP - 28

BT - Proceedings - 2020 IEEE VIS Arts Program, VISAP 2020

A2 - Brunvand, Erik

A2 - Han, Yoon Chung

A2 - Hull, Carmen

A2 - Lantin, Maria

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 27 October 2020 through 29 October 2020

ER -

Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this