Lessons Learned from the CLAIMS 1.0 study: Guidelines for Future Research-based Conceptual Learning Assessment Instrument Developers and Users

The Conceptual Learning Assessment Instrument Methodological Survey (CLAIMS) 1.0 was the first survey designed to investigate STEM Research-based Conceptual Learning Assessment Instrument (RbCLAI) developers views on the methodologies they used to develop their instruments as well as what claims that they can make about their instrument. The CLAIMS 1.0 consists of 29 items covering: instrument development methodology, evidence for the instruments’ validity, as well as any evidence gathered that was not published at the time of development. While the CLAIMS was sent to 100 different RbCLAI developers identified within STEM DBER fields, only 29 developers completed the CLAIMS 1.0. Analysis of the results of this survey provides lessons for any developer or user of a RbCLAI to be aware of during development and use.