This paper presents the initial investigation of the use of complexity as a surrogate for problem difficulty in predicting the effort or point value of an exam problem. In previous research, complexity of graph-based models has been used to predict market value of products using function models and to predict assembly time from connectivity graphs. This research investigates the potential of applying graphical representations and complexity metrics for exam problem solutions using expert assigned values as an appropriate method to offer point values for new exam questions. The factors and sources of problem difficulty are examined and compared to the structural complexity of a graphical representation of the problem solution. Specifically, this paper presents a protocol for developing the graphical representation. Multiple participants used the protocol to create graphical models of three exam questions to test and validate the usability of the protocol. A secondary protocol was tested to improve the rater agreement for use of the protocol. This protocol will be used for transforming exam problems into graphical models that can be analyzed with the connectivity complexity metrics. These metrics will be used to create predictive models for point assignments based on historical data.
Skip Nav Destination
ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
August 4–7, 2013
Portland, Oregon, USA
Conference Sponsors:
- Design Engineering Division
- Computers and Information in Engineering Division
ISBN:
978-0-7918-5584-3
PROCEEDINGS PAPER
Correlating Problem/Process Exam Question Complexity to Anticipated Effort: A Modeling Protocol
Samantha Thoe,
Samantha Thoe
Clemson University, Clemson, SC
Search for other works by this author on:
Joshua D. Summers
Joshua D. Summers
Clemson University, Clemson, SC
Search for other works by this author on:
Samantha Thoe
Clemson University, Clemson, SC
Joshua D. Summers
Clemson University, Clemson, SC
Paper No:
DETC2013-12301, V001T04A012; 9 pages
Published Online:
February 12, 2014
Citation
Thoe, S, & Summers, JD. "Correlating Problem/Process Exam Question Complexity to Anticipated Effort: A Modeling Protocol." Proceedings of the ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 1: 15th International Conference on Advanced Vehicle Technologies; 10th International Conference on Design Education; 7th International Conference on Micro- and Nanosystems. Portland, Oregon, USA. August 4–7, 2013. V001T04A012. ASME. https://doi.org/10.1115/DETC2013-12301
Download citation file:
10
Views
Related Proceedings Papers
Related Articles
Characterization of Spatial Parasitic Motions of Compliant Mechanisms Induced by Manufacturing Errors
J. Mechanisms Robotics (February,2016)
Digital Twins: Review and Challenges
J. Comput. Inf. Sci. Eng (June,2021)
Serial Metamorphic Manipulator Dynamics Formulation Implementing Screw Theory Tools
Letters Dyn. Sys. Control (October,2024)
Related Chapters
Concluding Remarks and Future Work
Ultrasonic Welding of Lithium-Ion Batteries
Assembly Modeling for Tolerance Analysis
International Conference on Instrumentation, Measurement, Circuits and Systems (ICIMCS 2011)
Digital Human in Engineering and Bioengineering Applications
Advances in Computers and Information in Engineering Research, Volume 1