Barman, Nabajeet, Reznik, Yuriy and Martini, Maria (2023) Datasheet for subjective and objective quality assessment datasets. In: 15th International Conference on Quality of Multimedia Experience (QoMEX 2023) : Towards sustainable and inclusive multimedia experiences; 20-22 Jun 2023, Ghent, Belgium.
Abstract
Over the years, many subjective and objective quality assessment datasets have been created and made available to the research community. However, there is no standard process for documenting the various aspects of the dataset, such as details about the source sequences, number of test subjects, test methodology, encoding settings, etc. Such information is often of great importance to the users of the dataset as it can help them get a quick understanding of the motivation and scope of the dataset. Without such a template, it is left to each reader to collate the information from the relevant publication or website, which is a tedious and time-consuming process. In some cases, the absence of a template to guide the documentation process can result in an unintentional omission of some important information. This paper addresses this simple but significant gap by proposing a datasheet template for documenting various aspects of sub-jective and objective quality assessment datasets for multimedia data. The contributions presented in this work aim to simplify the documentation process for existing and new datasets and improve their reproducibility. The proposed datasheet template is available on GitHub1, along with a few sample datasheets of a few open-source audiovisual subjective and objective datasets.
Actions (Repository Editors)
 |
Item Control Page |