Paper Info
Title
Scaling-Up and Speeding-Up Video Analytics Inside Database Engine
Abstract
Most conventional video processing platforms treat database merely as a storage engine rather than a computation engine, which causes inefficient data access and massive amount of data movement. Motivated by providing a convergent platform, we push down video processing to the database engine using User Defined Functions (UDFs). However, the existing UDF technology suffers from two major limitations. First, a UDF cannot take a set of tuples as input or as output, which restricts the modeling capability for complex applications, and the tuple-wise pipelined UDF execution often leads to inefficiency and rules out the potential for enabling data-parallel computation inside the function. Next, the UDFs coded in non-SQL language such as C, either involve hard-to-follow DBMS internal system calls for interacting with the query executor, or sacrifice performance by converting input objects to strings. To solve the above problems, we realized the notion of Relation Valued Function (RVF) in an industry-scale database engine. With tuple-set input and output, an RVF can have enhanced modeling power, efficiency and in-function data-parallel computation potential. To have RVF execution interact with the query engine efficiently, we introduced the notion of RVF invocation patterns and based on that developed RVF containers for focused system support. We have prototyped these mechanisms on the Postgres database engine, and tested their power with Support Vector Machine (SVM) classification and learning, the most widely used analytics model for video understanding. Our experience reveals the value of the proposed approach in multiple dimensions: modeling capability, efficiency, in-function data-parallelism with multi-core CPUs, as well as usability; all these are fundamental to converging data-intensive analytics and data management.
Year
DOI
Venue
2009
10.1007/978-3-642-03573-9_19
DEXA
Keywords
Field
DocType
database engine,rvf invocation pattern,rvf execution interact,computation engine,industry-scale database engine,storage engine,query engine,speeding-up video analytics inside,postgres database engine,udf execution,rvf container,value function,data access,power efficiency,video processing,support vector machine,data management,parallel computer
Data mining,Video processing,Tuple,Computer science,Input/output,Database engine,User-defined function,Analytics,Data management,Data access,Database
Conference
Volume
ISSN
Citations 
5690
0302-9743
3
PageRank 
References 
Authors
0.41
10
4
Name
Order
Citations
PageRank
Qiming Chen12010233.16
Meichun Hsu23437778.34
Rui Liu3256.45
Weihong Wang458244.63