University of Texas at Arlington

data validation methodology

April 12, 2019
Mavs Dataverse Logo

[This is the fourth part in a series of blog posts about our data gathering, processing and analysis methodology.]

In this post, I will tie up a few loose ends regarding data collection and cleanup, potential problems with our methods and how we have corrected for them with version 2.0 of the Maker Literacies program, and then provide some examples of how the data can be used for analysis.

Description of the pre- and post-self-assessment surveys

Keep in mind that everything covered up to this point has been an experimental proof-of-concept pilot, including the program itself...

Tags: ie 4340, data validation methodology, maker literacy, IMLS
February 8, 2019
Mavs Dataverse Logo

[This is the third in a series of blog posts about our data gathering, processing and analysis methodology.]

Picking up where I left off in my last post, in this post I will explain the process for identifying unreliable responses in the Public Pre-Post Combined Assessment Data FA17-FA18. For the purposes of this post, I am including a revised version of the Excel file, where I have used three criteria to help identify potentially unreliable results: intraclass correlation coefficient (ICC), average absolute deviation (AAD), and survey response durations from both pre- and post-self...

Tags: maker literacy, IMLS, data validation methodology
December 21, 2018
IMLS Logo

[This is the second in a series of blog posts about our data gathering, processing and analysis methodology.]

Happy Holidays!

Because of other priorities, I have not been able to move to the next steps in our data gathering, processing and analysis series. As we drew nearer to the end of the fall 2018 semester, I decided it would be best to wait until all of the fall 2018 data had been collected and aggregated with the original data set before moving forward with processing and analysis.

So now that I’ve collected and aggregated fall 2018 data, here are the updated...

Tags: IMLS, maker literacy, data validation methodology
November 13, 2018
IMLS Logo

[This is the first in a series of blog posts about our data gathering, processing and analysis methodology.]

While we still have not completed our final report to the IMLS, nor have I finished analyzing the student self-assessment data gathered from our pilot program, I feel that it’s time to release the public version of our raw data set. Rather than waiting until all data has been analyzed, I plan to post regular weekly (or monthly, as time permits) updates that will take readers through our methodology and ultimately reveal some of our findings.

Before questions are raised...

Tags: IMLS, maker literacy, data validation methodology