Title
Perception-driven semi-structured boundary vectorization.
Abstract
Artist-drawn images with distinctly colored, piecewise continuous boundaries, which we refer to as semi-structured imagery, are very common in online raster databases and typically allow for a perceptually unambiguous mental vector interpretation. Yet, perhaps surprisingly, existing vectorization algorithms frequently fail to generate these viewer-expected interpretations on such imagery. In particular, the vectorized region boundaries they produce frequently diverge from those anticipated by viewers. We propose a new approach to region boundary vectorization that targets semi-structured inputs and leverages observations about human perception of shapes to generate vector images consistent with viewer expectations. When viewing raster imagery observers expect the vector output to be an accurate representation of the raster input. However, perception studies suggest that viewers implicitly account for the lossy nature of the rasterization process and mentally smooth and simplify the observed boundaries. Our core algorithmic challenge is to balance these conflicting cues and obtain a piecewise continuous vectorization whose discontinuities, or corners, are aligned with human expectations. Our framework centers around a simultaneous spline fitting and corner detection method that combines a learned metric, that approximates human perception of boundary discontinuities on raster inputs, with perception-driven algorithmic discontinuity analysis. The resulting method balances local cues provided by the learned metric with global cues obtained by balancing simplicity and continuity expectations. Given the finalized set of corners, our framework connects those using simple, continuous curves that capture input regularities. We demonstrate our method on a range of inputs and validate its superiority over existing alternatives via an extensive comparative user study.
Year
DOI
Venue
2018
10.1145/3197517.3201312
ACM Trans. Graph.
Keywords
Field
DocType
clip-art, vectorization
Clip art,Computer vision,Colored,Raster graphics,Computer graphics (images),Computer science,Vectorization (mathematics),Artificial intelligence,Perception,Piecewise
Journal
Volume
Issue
ISSN
37
4
0730-0301
Citations 
PageRank 
References 
2
0.36
31
Authors
7
Name
Order
Citations
PageRank
Shayan Hoshyari120.36
Edoardo Alberto Dominici220.36
Alla Sheffer33074143.00
Nathan Carr423217.24
Zhaowen Wang5106340.64
Duygu Ceylan681.46
I-Chao Shen710913.17