Rubric Development for Evaluating Fictional Texts: Validity and Reliability Study

This study aims to develop a rubric that enables the evaluation of the fictional texts produced by middle school students with a holistic view, accurately and objectively, and to perform the validity and reliability studies of the developed rubrics. For this aim, firstly the relevant body of literature was reviewed and an item pool was created. Then, these items were represented to the opinions of four domain experts to ensure the validity of the rubric. In line with the feedback from the domain experts, the items were given their final form. Therefore, the rubric has a structure consisting of 25 items and enabling performance evaluation in 4-point likert scale. Then, in a secondary school in the city center of Van, fictional texts were written, without topic limitation, in a total of 40 students studying at different grade levels. These fictional texts were given points by two different Turkish teachers using rubric developed. To look at the consistency between the scores of Turkish language teachers, Krippendorff's Alpha Coefficient and Pearson Moments Multiplication Correlation Coefficient were used. As a result of the analysis, Krippendorff's Alpha Coefficient was 0,92 and Pearson Moments Multiplication Correlation Coefficient was 0,94. Consequently, it was concluded that the rubric developed within the scope of this study is a valid and reliable measurement tool that can be used in the evaluation of fictional texts written by middle school students. This rubric, which has been tested as a result of various procedures as a valid and reliable measurement tool, can be used by Turkish language teachers in evaluating the fictional texts produced by middle school students. Turkish language teachers, with the help of this rubric, can evaluate the fictional texts written by students correctly and objectively and find the opportunity to score easily.

Keywords

Fictional text, writing skills, rubric development, validity and reliability study.