Current Test Development Projects
Fire Engineer (Driver/Operator)
IPMA-HR is developing a test for Fire Engineer (Driver/Operator). This includes personnel whose primary duties may involve Driving and Positioning Emergency Vehicles, Maintaining Emergency Vehicles and Related Equipment, Performing Aerial Ladder Platform Operations, and Performing Pumping Operations. The two phases of development are outlined below. You are not required to participate in both phases. You can participate in either phase or both phases.
Job Analysis Phase
The first step in the development process is easy! All we need is the completion of web-based job analysis questionnaire by as many incumbents as possible and the completion of KSAP-to-linkage questionnaires by as many first- or second-line supervisors as possible. The questionnaires take about an hour to complete and everything is automated. You just have to send the incumbents and supervisors a link to the questionnaire for them to complete. That’s it! The responses come right to us.
Subject Matter Expert (SME) Question Review
SMEs who agree to participate in the question review will be asked to read the questions and rate their appropriateness for the test They will also be asked if the wording of the question is clear and whether or not they think the answer given is correct. For this study, SMEs should be first- and second-line supervisors who have direct responsibility for the supervision of fire engineers within the fire department. When choosing the staff that you will ask about participation, keep in mind the complexity of the task and the confidential nature of the questions to be reviewed.
In an effort to increase participation in this test development project, we have redesigned the study and are now offering agencies two alternatives to participation. Here are the options: 1) ask qualified supervisors (i.e., SMEs) to participate in the question review process on their off duty time and IPMA-HR will pay them for their participation. You would only have to provide us with a list of names and contact information for those SMEs that agree to participate. We will do the rest! 2) Have your supervisors complete the question review during work hours and your agency will get a larger discount on their next test order!
Entry-Level Correctional Officer Test
The first step includes the administration of multiple choice tests to incumbents. Test administration should take approximately 2 to 3 hours. The second step requires asking one or more first- or second line supervisors to evaluate the job performance of those tested. Each evaluation should take approximately 10 minutes to complete. These evaluations will only be used to compare test performance with job performance and will be kept strictly confidential. The evaluation form can be completed via paper copies or a secure, web-based form.
These steps are conducted to collect criterion-based validity evidence to support the use of the exams in public safety agencies across the country. Data collected will be combined with that provided by other participating agencies. An item analysis will be run on the data to determine the best questions to include on the test. The tests and performance evaluation data will then be used to conduct the statistical analysis to ensure that test performance predicts job performance.