Community Attention Check Library - Add Your Own!

🌍 The Co-Lab Community Libraries
#1

All details below :slight_smile:

#2

Fair Attention Check Library

Attention checks are an important tool in the fight against bad data quality. But, we also want to make sure that any checks that are used are fair.

We know that you face two key problems in this area:

  1. It’s not clear what a ‘fair’ attention check looks like in some scenarios
  2. Some researchers are great at making fair attention checks, but others need more guidance.

How are we going to solve these problems?

  1. We’ll soon be releasing brand-new guidance that aims to be clearer.
  2. We’re launching a Community Attention Check Library

The Library

This will be a resource created by the community, for the community! You’ll be able to submit attention checks which can be used by other members. The process is simple:

  1. Use this template
  2. Submit your attention checks here
  3. Our team will review it within the next few weeks, and if it needs to be made more ‘fair’, we’ll contact you with our recommended changes.

Note: This is just an initial test of this idea, so our release of the approved checks may take longer than expected, and we may not be able to fully launch this for some time.

Looking forward to your submissions!

1 Like
#3

Hi Josh, When I’m clicking on “Submit your attention checks here”, I get an error message saying that I need permission

image
image1702×655 40.9 KB

1 Like
#4

My apologies! I’ve just removed that restriction.

Thanks so much for submitting!

1 Like