A page from the OpenDepot.org service

Jump to the start of the main contents

Li, Yuan and Westland, Stephen and Cheung, Vien (2012) Models Estimation for Incomplete Paired-Comparison Experiments Based on Least-Squares Solution. In: Predicting Perceptions: Proceedings of the 3rd International Conference on Appearance. Lulu Press, Edinburgh UK, pp. 89-91. ISBN 978-1-4716-6869-2

[img]
Preview
PDF (Models Estimation for Incomplete Paired-Comparison Experiments Based on Least-Squares Solution) - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (520Kb) | Preview

    Abstract

    Incomplete paired comparison is an important scaling technique in vision science since the total number of paired comparisons for n stimuli is n(n-1)/2 which becomes prohibitive for large values of n. However, the experimental designer often struggles with questions such as what is the smallest limit for the proportion of paired comparisons included that will still allow reliable estimations of scale values? Monte-Carlo computational simulations were previously carried out using a model of an ideal observer. The results showed that the proportion of paired comparisons that is included is more critical than the number of observers who make those observations. This work aims to test the results from the computational simulation with 25 real observers and 10 stimuli from the gray scale. The psychophysical data suggest that when each observer evaluates the same pairs, accuracy of the derived scale values increases with the proportion of pairs evaluated and the number of observers; the proportion of pairs is, however, more critical and this agrees with the results of the simulation. The psychophysical data also suggest when the each observer estimates a different pairs (albeit with the same proportion of pairs being evaluated) the accuracy of scale values does not always increase monotonically with the number of pairs being evaluated.

    Item Type: Book Section
    Uncontrolled Keywords: Incomplete paired-comparison experiment, model verification, Morrissey’s least squares solution.
    Subjects: UNSPECIFIED
    Divisions: UNSPECIFIED
    Depositing User: Dr Stefano Padilla
    Date Deposited: 07 May 2012 11:08
    Last Modified: 08 May 2012 12:26
    URI: http://opendepot.org/id/eprint/1067

    Actions (login required)

    View Item