As mentioned in another post, I have been trying to run online multiplayer experiments with big groups (at least 8 at a time). However, there are a lot of complications and moving parts involved in doing so. The main aim is to get a lot of people to come in at the same time so that people don’t have to wait for the groups to slowly fill up.
It was recommended to me that I follow a process similar to that of video/audio interview. This involves creating a study, where participants are directed to a scheduling tool to schedule when they will participate. In the meantime, they have to be given a code so that they can submit the study and do other studies between now and then.
I decided to do without the scheduling tool, they can have privacy issues (even Doodle encourages - although does not force - participants to put in some sensitive information such as names and emails). Instead, I do everything in one link with my coding. Participants are sent to a page that tells them that the study will start in X amount of time and to come back here on time before it starts. It informs them about the code to be able to continue and reminds them that they have to actually complete the study to receive payment.
Nevertheless, we are left with quite a few moving parts and complications:
- Participants might lose the link or not get a reminder to come back to the study in time. (sending a reminder message 15 mins before might not reach them as they won’t get a notification in the browser add-on).
- Participants might not return their participation if they didn’t complete the study. It’s never nice to have to chase participants to return their study, nor report them if they refuse to do so.
- This can still seem weird to participants.
- They might not plan well and start another study just before ours.
- They might over-plan and wait in front of our study for a whole chunk of time before it starts.
I was wondering if Prolific might consider removing all these moving parts by creating an option do to studies where participants register for a later start. The experimenter would set when to publish the study and when to release the actual link to the study. The participants would register for it. No need to do stuff by providing a code and it wouldn’t block them from doing other studies. They get a reminder a few minutes before the start, where they can click and get to the actual study. This would make things a lot simpler for experimenters and a lot clearer for participants.
(bonus points if you can replace the scheduling process for the video and audio interviews, but I am just interested in this fix for multiplayer experiments, I don’t need people to choose amongst different time slots, just one time to come back to later in the day.)
Thank you for time