As far as implementing this, whatâs the simplest route do you think? Would we need to manually identify how many tasks each participant performed and then provide them with that bonus? Or, are we able to pass a URL parameter back to Prolific that includes the number of tasks completed, and that being used to automatically calculate bonus? I assume not possible but wanted to check.
Are we able to pass a URL parameter back to Prolific that includes the number of tasks completed, and that being used to automatically calculate bonus?
Unfortunately, this wonât be possible. But, to make the manual proces easier, you can:
Using your external survey software, track how many tasks each participant completes
Group participants according to the number theyâve completed
Export the IDs of the participants in the various groups, and âbulk payâ those IDs with their relevant bonus
It expects some string after ?PROLIFIC_PID= the problem is, we arenât getting that parameter passed along to us by Prolific, and so participants are unable to access our site. Do you have any idea why the parameters would not be passed along?
I set myself up as a participant so I could troubleshoot this, but itâs really difficult, and my study isnât appearing as an option to my âParticipantâ account, despite my About Me and the studyâs prescreener matching me perfectly. Whatâs the best way for me to do a true test of our study, end to end, so I can troubleshoot why the Prolific parameters are being lost? Thanks!
The Session ID is way above my head. I am very sorry I canât help you there. I am also stumped as to why your prolificsb account canât access the survey.
But may I ask why you ate not carrying out the sudies sequentially? That would be a simple way of running two studies with diffeerant criteria. There is a function for blacklisting particioants of other studies. If you copy a study then participants of the copied study are automatically excluded from the copy (ah, could this be why your prolificsb account is unable to participate?).
You could I think increase the places on each study alternately to ensure that both studies are taking place at almost the same time. (In that case however I think you would have to use the manual blacklist to prevent participants from taking both studies.)
The best way is to use a custom allowlist which only has your participants account ID on it.
Studies arenât distributed by our system only on the basis of eligibility. We also distribute them according to how many studies a participant has done previously to ensure we maintain naivety. So, itâs not guaranteed that youâd receive a study just because youâre eligible.
Thanks, this is a great response @Josh. Iâll check the URL fix you suggest on our next deploy.
In the meantime, Iâm still unable to access my study from my participant account, even after making a custom allowlist. (Pictures attached.) Is this because of your comment on how Studies arenât distributed by the system only on the basis of eligibility? I really need to be able to test our study end to end; it seems like thereâs got to be a workaround here.
@Josh searches donât bring anything up, but Iâm looking for any information on implementing a non-disclosure agreement into a study. Is there a means for adding this?
But, in practical terms it may be difficult (or impossible) to enforce these sorts of restrictions against anonymous participants in your study.
The only requirement that we have is that participation on Prolific must remain anonymous. Beyond this, how exactly you manage the agreement within your study is up to you as data controller (see Data Protection and Privacy).
is it possible to request an exception to the anonymity rule? Weâre working with a startup and theyâre - understandably - highly concerned about participants leaking their idea.
Of course, weâd clearly communicate this exception to potential participants, and only those willing to sign the NDA would be a part of the study.
Singing the NDA would be done through a secured digital signing service such as DocuSign or Hellosign. Weâd need the participantâs name, surname, and address for NDA to be binding.
Other than signing the NDA, the rest of the video survey would be per the usual Prolific process.
Not being able to get participants to sign NDA prior to seeing the prototype would mean weâd need to look elsewhere for recruiting participants.
Unfortunately, we donât make any exceptions to the anonymity rule. We do have participants who are willing to sign NDAs, and studies have been run successfully in the past using them. But we do appreciate it would be difficult to enforce such an agreement with anonymous individuals.
Could you tell me how the âmaximum time allowedâ is computed prior to collecting data?
It says this is âautomatically calculated based on your estimated completion time.â, but how is this done precisely?
I looked everywhere and could not find an answer to this.
Two short is three standard deviations less than the mean but too long is set before standard deviation and mean is known so it is just some function of the time estimated by the researcher, I presume, but if we are to know (and it may be a secret) Josh or someone from Prolific will have to enlighten us.
Hereâs some more info on why we set a max time, and how we calculate it:
Prolific uses the maximum time to time-out submissions who are inactive (i.e. left the study). As a result, this cannot be too close to the estimated completion time to avoid unfairly excluding participants who take slightly longer to complete than your estimate.
If you need to set an absolute maximum completion time in your study, you should programme this within your survey software and make sure you clearly communicate this to your participants. If you do this, you can then reject submissions which go over this time or just remove them from your analysis.
The calculation for the minimum value of the maximum time allowed is as follows (where X is your estimated completion time): Minimum Maximum Allowed Time = 2 + X + (2*sqrt(X))
Iâm new here and I was wondering what the units for the equation are. Is it in hours or minutes? That affects the meaning of the â2â in the front by quite a bit.
Also, does Prolific automatically use the minimum maximum allowed time? In other words, do researchers have to choose something equal to or above it, or is it a default setting? If itâs a default setting, how easily can it be changed?