|
B. Erol, E. Antunez, J.J. Hull, HOTPAPER: Multimedia Interactions with Paper using Mobile Phones, ACM Multimedia 2008.
Abstract:
The popularity of camera phones enable many exciting
multimedia applications. In this paper, we present a novel
technology and applications that are enabled by this technology
that allow users to interact with paper documents, books, and
magazines. This interaction is in the form of reading and writing
electronic information, such as images, web urls, video, and audio,
to the paper medium by pointing a mobile phone to a patch of text
on a document. Our application does not require any special
markings, barcodes, or watermarks on paper. Instead, we propose
a document recognition algorithm that automatically determines
the location of a patch of text in a large collection of document
images given a small document image. This is very challenging
because the majority of phone cameras lack autofocus and macro
capabilities and they produce low quality images and video. We
developed a novel algorithm, Brick Wall Coding (BWC), that
performs document recognition on the mobile phone video frames.
Given a document patch image, BWC utilizes the layout, i.e.
relative locations, of word boxes in order to determine the original
file, page, and the location on the page. BWC runs real-time (4
frames per second) on a Treo 700w smartphone with a 312 MHz
processor and 64MB RAM. Using our method we can recognize
blurry document patch frames that contain as little as 4-5 lines of
text and a video resolution as low as 176×144. We performed
experiments by indexing 4397 document pages and querying this
database with 533 document patches. Besides describing the basic
algorithm, this paper also describes several applications that are
enabled by mobile phone-paper interaction, such as inserting
electronic annotations to paper, using paper as a tangible interface
to collect and communicate multimedia data, and collaborative
homework.
Bibtex:
@inproceedings{eah-hmipmp-08,
author = {Erol, Berna and Ant'{u}nez, Emilio and Hull, Jonathan J.},
title = {HOTPAPER: multimedia interaction with paper using mobile phones},
booktitle = {MM '08: Proceeding of the 16th ACM international conference on Multimedia},
year = {2008},
isbn = {978-1-60558-303-7},
pages = {399--408},
location = {Vancouver, British Columbia, Canada},
doi = {http://doi.acm.org/10.1145/1459359.1459413},
publisher = {ACM},
address = {New York, NY, USA},
}
|
|