Title
The Frankencamera: an experimental platform for computational photography
Abstract
Although there has been much interest in computational photography within the research and photography communities, progress has been hampered by the lack of a portable, programmable camera with sufficient image quality and computing power. To address this problem, we have designed and implemented an open architecture and application programming interface (API) for such cameras: the Frankencamera. It consists of a base hardware specification, a software stack based on Linux, and an API for C++. Our architecture permits control and synchronization of the sensor and image processing pipeline at the microsecond timescale, as well as the ability to incorporate and synchronize external hardware like lenses and flashes. This paper specifies our architecture and API, and it describes two reference implementations we have built. Using these implementations, we demonstrate several computational photography applications: high dynamic range (HDR) viewfinding and capture, automated acquisition of extended dynamic range panoramas, foveal imaging, and inertial measurement unit (IMU)-based hand shake detection. Our goal is to standardize the architecture and distribute Frankencameras to researchers and students, as a step toward creating a community of photographer-programmers who develop algorithms, applications, and hardware for computational cameras.
Year
DOI
Venue
2012
10.1145/2366316.2366339
ACM Transactions on Graphics
Keywords
Field
DocType
extended dynamic range panorama,computational camera,experimental platform,synchronize external hardware,open architecture,computational photography application,base hardware specification,image processing pipeline,high dynamic range,photography community,computational photography
Open architecture,Computer science,Computational photography,Image processing,Photography,Software,Inertial measurement unit,Application programming interface,High dynamic range,Embedded system
Journal
Volume
Issue
ISSN
55
11
0001-0782
Citations 
PageRank 
References 
49
3.23
18
Authors
15
Name
Order
Citations
PageRank
Andrew Adams193653.55
David E. Jacobs21578.71
Jennifer Dolson327114.03
Marius Tico422825.61
Kari Pulli52170157.09
Eino-Ville Talvala636226.00
Boris Ajdin71789.28
Daniel Vaquero81539.61
Hendrik P. A. Lensch9147196.59
Mark Horowitz1063741543.34
Sung Hee Park1111610.11
Natasha Gelfand12123667.99
Jongmin Baek1328314.08
Wojciech Matusik144771254.42
Marc Levoy15102731073.33