Please follow the instructions for each step on the task.
Please also watch this short video for an example. Note that the sounds in the example may be different from the task you are attempting.

For any questions:

Please use the 'Contact this requester' link on the HIT details if you need further details or clarifications on the task. The Principal Investigator (the person in charge of this research) or his/her representative will describe this research to you and answer all of your questions.
Note: On using this feature, your e-mail address and your name will automatically be visible to our research team so that we can reply to you.

Please see summary tab for all instructions.

Welcome to the qualitative evaluation of artificially synthesized audio clips using deep neural networks  

Thank you for your interest in this audio evaluation task on Mechanical Turk. This page outlines the details with respect to your consent to participate in our study.


Protocol Title:
Qualitative evaluation of artificially synthesized audio clips synthesized using deep neural networks


Purpose of this research:
The purpose of this research is to evaluate the quality of synthetic audio clips generated using an artificial neural network. The audio clips under test belong to the domain of audio textures (for e.g. a series of popping sounds, the ticking sound made by a Geiger counter or the sound made by water filling a container) or pitches made by musical instruments. The specific goal of this project is to ensure that the synthetic outputs generated by these deep learning models are validated by human beings to test for certain sound qualities like smoothness, naturalness or absence of noise etc.


Contacting Us:
Please use the "Contact this requester" link on the Mechanical Turk's HIT details section if you need further details or clarifications on the task. The Principal Investigator (the person in charge of this research) or his/her representative will answer all of your questions. Note: On using this feature, your e-mail address and your name will automatically be visible to our research team so that we can reply to you.


Your personal data:
Only the principal investigator and his/her representative has your worker ID and this will not be released to any other person. We will NOT request Amazon Mechanical Turk for your person identifying details. Also, this worker ID data will not be used in a publication or presentation. We will use this worker ID only for the purposes of correlating consent to HIT responses and distributing compensation via Mechanical Turk.

All data collected will be kept in accordance to the University's Research Data Management Policy. Research data used in any publication will be kept for a minimum of 10 years before being discarded.


By accepting the HIT on Amazon's Mechanical Turk, you acknowledge that -
  1. You have agreed to take part in this research.
  2. You have read the instructions on the mechanical turk website and details on this form which explains the use of the data you submit for this research.
  3. You can withdraw from this research at any point of time. If you want the data you already submitted to be deleted you will inform the Principal Investigator and all your data will be discarded.
  4. You will not have any financial benefits that result from the commercial development of this research.
  5. You agree to be re-contacted for future related studies via Amazon's Mechanical Turk website. You understand that future studies will be subject to an Institutional Review Board's approval. 
 

Note: Please accept this HIT only if you are on a laptop/desktop with the most recent Chrome/Firefox browsers

Audio Perceptual Ordering Task

Please follow the instructions for each step below to complete this task.

 
1.
 
Listen to the 2 reference audio samples displayed below.
 
 
 
2.
 
Listen to all 5 color coded audio samples displayed below. Each audio clip below can be perceptually placed 'in-between' the audio clips in Step 1.
 
 
 
 
 
 
 
 
 
3.
 
Each audio color coded audio clip in step 2 above has a corresponding slider thumb below.

Move/arrange each audio's corresponding slider to a position between the two reference audio clips.

Note that you can play an audio clip by double clicking on its corresponding colored slider thumb.
 
 
 
 
 
4.
 
Click on the button below to listen to the arrangement to answer steps 4 & 5.
 
 
 
Click Here To Listen to the Arrangement
 
 
5.
 
Adjust Ordering Step: Please redo from Step 2 if the arrangement does not sound to be in some order of sequence.
 
 
 

 
 
6.
 
Adjust Distance Step: Please adjust the sliders for each audio clip in Step 2 inline with the distance of each clip from each other.
 
 
 

 
 
7.
 
Submit the HIT.
Please attempt this task only if you are on Firefox or Chrome.