Can relative skill be determined from a photographic portfolio?

Abhishek Agrawal; Vittal Premachandran; Rajesh Somavarapu; Ramakrishna Kakarala

doi:10.1117/12.2008065

14 March 2013 Can relative skill be determined from a photographic portfolio?

Abhishek Agrawal, Vittal Premachandran, Rajesh Somavarapu, Ramakrishna Kakarala

Proceedings Volume 8651, Human Vision and Electronic Imaging XVIII; 86510X (2013) https://doi.org/10.1117/12.2008065
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

In this study, our primary aim is to determine empirically the role that skill plays in determining image aesthetics, and whether it can be deciphered from the ratings given by a diverse group of judges. To this end, we have collected and analyzed data from a large number of subjects (total 168) on a set of 221 of images taken by 33 photographers having different photographic skill and experience. We also experimented with the rating scales used by previous studies in this domain by introducing a binary rating system for collecting judges’ opinions. The study also demonstrates the use of Amazon Mechanical Turk as a crowd-sourcing platform in collecting scientific data and evaluating the skill of the judges participating in the experiment. We use a variety of performance and correlation metrics to evaluate the consistency of ratings across different rating scales and compare our findings. A novel feature of our study is an attempt to define a threshold based on the consistency of ratings when judges rate duplicate images. Our conclusion deviates from earlier findings and our own expectations, with ratings not being able to determine skill levels of photographers to a statistically significant level.

Citation Download Citation

Abhishek Agrawal, Vittal Premachandran, Rajesh Somavarapu, and Ramakrishna Kakarala "Can relative skill be determined from a photographic portfolio?", Proc. SPIE 8651, Human Vision and Electronic Imaging XVIII, 86510X (14 March 2013); https://doi.org/10.1117/12.2008065

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available