Data Collection Process
The data in the Quality Compendium comes directly from QIS administrators or other staff representing the system in each state or locality. Child Trends used the following process to update the data on a yearly basis:
-
Child Trends gives the QIS administrator (or other designated staff person) access to their profile on the backend of the website. They review the information for accuracy, fill in gaps, and ensure their profile is complete.
-
Child Trends staff reviews the profile and notes any errors or inconsistencies with our definitions and intentions for each data element/field.
-
In the 2021 data collection process, Child Trends staff also interviewed QIS administrators to ensure consistent interpretation of data elements across states.
-
The QIS profiles are made public on the front end of the website.
Child Trends has been updating all the data since 2014. It started as an annual process, but shifted to a biannual update in 2017. During a data collection year, Child Trends staff go through the process outlined above with all currently operating QIS. The entire process takes about 3 months. For states or localities that do not have a QIS or one that is fully operational, they will not complete a full profile but may submit a brief description to post on the website. When a new QIS profile is being added to the website, Child Trends uses the following, extended process:
-
Child Trends staff reviews the information available online about the QIS and enters information into a new profile on the backend of the website.
-
The QIS administrator (or other designated staff person) is given access to their profile on the backend of the website. They review the information for accuracy, fill in gaps, and ensure their profile is complete.
-
Child Trends staff reviews the profile and notes any errors or inconsistencies with our definitions and intentions for each data element/field.
-
Child Trends staff interviews the QIS administrator (or other designated staff person) over the phone to discuss any final edits to the information in their profile.
-
The QIS profile is made public on the frontend of the website.
It is important to note that we consider the data in the Quality Compendium to be self-reported. We review the information to ensure it is consistent with our definitions and intentions for the website, however we do not conduct audits of the information.