Name
Title | ||
|---|---|---|
Low Latency Event-Based Filtering and Feature Extraction for Dynamic Vision Sensors in Real-Time FPGA Applications |
Abstract | ||
|---|---|---|
Dynamic Vision Sensor (DVS) pixels produce an asynchronous variable-rate address-event output that represents brightness changes at the pixel. Since these sensors produce frame-free output, they are ideal for real-time dynamic vision applications with real-time latency and power system constraints. Event-based filtering algorithms have been proposed to post-process the asynchronous event output to reduce sensor noise, extract low level features, and track objects, among others. These postprocessing algorithms help to increase the performance and accuracy of further processing for tasks such as classification using spike-based learning (ie. ConvNets), stereo vision, and visually-servoed robots, etc. This paper presents an FPGA-based library of these postprocessing event-based algorithms with implementation details; specifically background activity (noise) filtering, pixel masking, object motion detection and object tracking. The latencies of these filters on the Field Programmable Gate Array (FPGA) platform are below 300ns with an average latency reduction of 188 (maximum of 570) over the software versions running on a desktop PC CPU. This open-source event-based filter IP library for FPGA has been tested on two different platforms and scenarios using different synthesis and implementation tools for Lattice and Xilinx vendors. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/ACCESS.2019.2941282 | IEEE ACCESS |
Keywords | DocType | Volume |
Feature extraction,Field programmable gate arrays,Sensors,Visualization,Voltage control,Real-time systems,Retina,Neuromorphic engineering,address-event-representation (AER),dynamic vision,frame-free vision,event-based processing,event-based filters,field programmable gate arrays (FPGA),VHDL | Journal | 7 |
ISSN | Citations | PageRank |
2169-3536 | 1 | 0.40 |
References | Authors | |
0 | 7 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Alejandro Linares-barranco | 1 | 473 | 53.18 |
| Fernando Perez-Peña | 2 | 10 | 5.80 |
| Diederik Paul Moeys | 3 | 21 | 3.88 |
| Francisco Gomez-Rodriguez | 4 | 1 | 0.40 |
| Gabriel Jiménez-moreno | 5 | 221 | 22.43 |
| Shih-chii Liu | 6 | 1005 | 103.47 |
| Tobi Delbrück | 7 | 876 | 82.59 |