Mapping and Visualizing Deep-Learning Urban Beautification

Tobias Kauer; Sagar Joglekar; Miriam Redi; Luca Maria Aiello; Daniele Quercia

doi:10.1109/MCG.2018.053491732

IEEE Computer Graphics and Applications

Mapping and Visualizing Deep-Learning Urban Beautification

Sept.-Oct. 2018, pp. 70-83, vol. 38

DOI Bookmark: 10.1109/MCG.2018.053491732

Authors

Tobias Kauer, University of Applied Sciences Potsdam
Sagar Joglekar, Kings College London
Miriam Redi, Nokia Bell Labs Cambridge
Luca Maria Aiello, Nokia Bell Labs Cambridge
Daniele Quercia, Nokia Bell Labs Cambridge

Keywords

Data Visualization, Visualization, Measurement, Smart Cities, Urban Areas, Complexity Theory, User Centered Design, Information Visualization, Data And Knowledge Visualization, Deep Learning, Urban Informatics, Computer Graphics

Abstract

Information visualization has great potential to make sense of the increasing amount of data generated by complex machine-learning algorithms. We design a set of visualizations for a new deep-learning algorithm called FaceLift (goodcitylife.org/facelift). This algorithm is able to generate a beautified version of a given urban image (such as from Google Street View), and our visualizations compare pairs of original and beautified images. With those visualizations, we aim at helping practitioners understand what happened during the algorithmic beautification without requiring them to be machine-learning experts. We evaluate the effectiveness of our visualizations to do just that with a survey among practitioners. From the survey results, we derive general design guidelines on how information visualization makes complex machine-learning algorithms more understandable to a general audience.

Like what you’re reading?

Already a member?

Get this article FREE with a new membership!

References

1.A. De Botton, “The Architecture Of Happiness,” Vintage, 2008.

2.D. Quercia, N.K. O'Hare, and H. Cramer, “Aesthetic Capital: What Makes London Look Beautiful, Quiet, And Happy?.,” Proceedings Of The 17th ACM Conference On Computer Supported Cooperative Work & Social Computing, 2014.

3.S. Joglekar and D. Quercia, “FaceLift: A Transparent Deep Learning Framework Recreating The Urban Spaces People Intuitively Love,” Under Review, 2018.

4.R. Ewing and O. Clemente, Measuring Urban Design: Metrics For Livable Places, Island Press, 2013.

5.L. Liu et al., A Machine Learning-based Method For The Large-scale Evaluation Of The Qualities Of The Urban Environment, 65, Computers, Environment and Urban Systems, 2017.

6.R. König et al., “Cognitive Computing For Urban Planning,” The Virtual And The Real In Planning And Urban Design, Claudia Yamu, Alenka Poplin, Oswald Devisch, Gert De Roo, Routledge, 2017.

7.N. Naik et al., “Computer Vision Uncovers Predictors Of Physical Urban Change,” Proceedings Of The National Academy Of Sciences, no. 29, 2017, pp. 70–83.

8.I. Seiferling et al., “Green Streets − Quantifying And Mapping Urban Trees With Street-level Imagery And Computer Vision,” Landscape And Urban Planning, vol. 165, 165, 2017, pp. 70–83.

9.A. Kachkaev and J. Wood, “Automated Planning Of Leisure Walks Based On Crowd-sourced Photographic Content,” 46th Annual Universities’ Transport Study Group Conference, 2014; http://openaccess.city.ac.uk/4943/.

10.A. Radford, L, Metz, and S. Chintala, Unsupervised Representation Learning With Deep Convolutional Generative Adversarial Networks, arXiv, 2015; doi.org/arXiv:1511.06434.

11.N. Naik et al., “Streetscore-predicting The Perceived Safety Of One Million Streetscapes,” Proceedings Of The IEEE Conference On Computer Vision And Pattern Recognition Workshops, 2014.

12.R. Herbrich, Z. Minka, and T. Graepel, “TrueSkill™: A Bayesian Skill Rating System,” Advances In Neural Information Processing Systems, 2007.

13.A. Nguyen et al., “Synthesizing The Preferred Inputs For Neurons In Neural Networks Via Deep Generator Networks,” Advances In Neural Information Processing Systems., 2016.

14.B. Zhou et al., “Learning Deep Features For Scene Recognition Using Places Database,” Advances In Neural Information Processing Systems, 2014.

15.V. Badrinarayanan, A. Kendall, and R. Cipolla, “Segnet: A Deep Convolutional Encoder-decoder Architecture For Image Segmentation,” ArXiv, 2015; doi.org/arXiv:1511.00561.

16.A.E. Stamps III, “Advances In Visual Diversity And Entropy,” Environment And Planning B: Planning And Design, vol. 30.3, 2003, pp. 70–83.

17.M. Dörk et al., “Critical InfoVis: Exploring The Politics Of Visualization,” CHI'13 Extended Abstracts On Human Factors In Computing Systems, 2013.

18.N. Elmqvist et al., “Fluid Interaction For Information Visualization,” Information Visualization, vol. 10, no. 4, 2011, pp. 70–83.

19.J. Harris, “Connecting With The Dots,” blog; https://source.opennews.org/articles/connecting-dots.

20.D. Quercia et al., “Psychological Maps 2.0: A Web Engagement Enterprise Starting In London,” Proceedings Of The 22nd International Conference On World Wide Web, 2013.

Diagnostic visualization for non-expert machine learning practitioners: A design study
2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
Staged analysis: From evocative to comparative visualizations of Urban mobility
2017 IEEE VIS Arts Program (VISAP)
Visual Analytics in Urban Computing: An Overview
IEEE Transactions on Big Data
Predicting Transportation Carbon Emission with Urban Big Data
IEEE Transactions on Sustainable Computing
STRAD Wheel: Web-Based Library for Visualizing Temporal Data
IEEE Computer Graphics and Applications
RuleMatrix: Visualizing and Understanding Classifiers with Rules
IEEE Transactions on Visualization & Computer Graphics
Visualizing Internal Sustainability Efforts in Big Companies
IEEE Computer Graphics and Applications
A Comparison of Spatiotemporal Visualizations for 3D Urban Analytics
IEEE Transactions on Visualization & Computer Graphics
Visual Analytics of Volunteered Geographic Information: Detection and Investigation of Urban Heat Islands
IEEE Computer Graphics and Applications
Showing Data About People: A Design Space of Anthropographics
IEEE Transactions on Visualization & Computer Graphics

Mapping and Visualizing Deep-Learning Urban Beautification

Authors

Keywords

Abstract

References

Related Articles