Tips for recruiting a custom sample

Hi, I have read through the guide (Recruiting a Custom Sample – Prolific) for recruiting a custom sample by using two surveys: one that is a set of screener questions and the second that is only available to those who fit the profile relevant to your study. I’m looking for any additional tips from researchers who have done this set-up before I start my own. For example:

  • Do you have an informed consent form for both surveys or only the second one (the actual research study)?
  • Do you have a rule of thumb for how many participants to open the screener questions to (e.g., x times the number you want to offer your main study to)?
  • I assume that the description of the first study should state that it is a screener for a larger study and that not everyone who completes it will be eligible for the second study (but will still get paid for completing the screener). Anything else that should be included here? Or, do you have a sample screener that you’d be willing to share?
  • Anything else that is important to keep in mind or that you wish you had known before doing your first study like this?

Thanks in advance!

1 Like

Hi @Jessica , I haven’t done this before. About the consent forms though, I would start by talking with your local IRB. Each one might have different policies, so it would be good to check with them first.

If you search through the newbie forum, you could find some users that have posted about these procedures and tag them here! It would be nice to have a thread with suggestions and best practices for everyone to find easily when they arrive at the forum.

1 Like

Great idea, @P.P !

In no particular order: @Xenia @MaryLou_Saks @Astrid_Thomsen @p_n_w @AlonZivony @Jesse_Scott @Corinna_Schmitt @John_Barbieri it sounds like you all may have done the custom sample procedure recently! Any tips or models for a new newbie? :grinning:

I’ve done this and had success with it. I had a separate information sheet and consent form for both the screening survey and the main study.

You will have to over-recruit with your screening survey but by how much depends entirely on how many people pass your screening and how appealing/easy/etc your main study is. I recommend doing a test run one day and seeing what % of your screened people actually complete your main study and go from there.

One thing I would highly recommend is running the screening survey immediately before the real study. I have an R script that reads in my qualtrics screening survey data and outputs a list of eligible Prolific IDs straight away, and so I then invite people into the main study within an hour or so of them completing the screening survey. I find that success at filling your main study reduces quickly if you leave a gap between the screening and main study (even by a day or two) as many people will complete the screening survey and then go about their lives and miss the follow up invitation or no longer be available. My main study was quite heavy going though, so that may have been a factor!

2 Likes