Since more processing power, new sensing and display technologies are already available in mobile devices, there
has been increased interest in building systems to communicate via different modalities such as speech, gesture,
expression, and touch. In context identification based user interfaces, these independent modalities are combined
to create new ways how the users interact with hand-helds. While these are unlikely to completely replace
traditional interfaces, they will considerably enrich and improve the user experience and task performance. We
demonstrate a set of novel user interface concepts that rely on built-in multiple sensors of modern mobile devices
for recognizing the context and sequences of actions. In particular, we use the camera to detect whether the user
is watching the device, for instance, to make the decision to turn on the display backlight. In our approach the
motion sensors are first employed for detecting the handling of the device. Then, based on ambient illumination
information provided by a light sensor, the cameras are turned on. The frontal camera is used for face detection,
while the back camera provides for supplemental contextual information. The subsequent applications triggered
by the context can be, for example, image capturing, or bar code reading.
In this paper we propose a novel color demosaicing algorithm for noisy data. It is assumed that the data is given according to the Bayer pattern and corrupted by signal-dependant noise which is common for CCD and CMOS digital image sensors. Demosaicing algorithms are used to reconstruct missed red, green, and blue values to produce an RGB image. This is an interpolation problem usually called color filter array interpolation (CFAI). The conventional approach used in image restoration chains for the noisy raw sensor data exploits denoising and CFAI as two independent steps. The denoising step comes first and the CFAI is usually designed to perform on noiseless data. In this paper we propose to integrate the denoising and CFAI into one procedure. Firstly, we compute initial directional interpolated estimates of noisy color intensities. Afterward, these estimates are decorrelated and denoised by the special directional anisotropic adaptive filters. This approach is found to be efficient in order to attenuate both noise and interpolation errors. The exploited denoising technique is based on the local polynomial approximation (LPA). The adaptivity to data is provided by the multiple hypothesis testing called the intersection of confidence intervals (ICI) rule which is applied for adaptive selection of varying scales (window sizes) of LPA. We show the efficiency of the proposed approach in terms of both numerical and visual evaluation.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.