Localisation of the common European framework of reference for languages written production illustrative descriptor scale to Malaysian higher education context

Abstract

The Common European Framework of Reference for Languages (CEFR) was introduced into the nation through the latest English in education policy reform that occurred in 2015. As the policy enactment encompasses all levels of education, the higher education sector was also affected by this reform. Consequently, all matters relating to English language education at Malaysian higher education (HE) level are to be CEFR aligned. This includes writing, the most important skill at tertiary level education. However, previous literatures have criticised CEFR for its intended European usage, European norms, and loose design allowing for differing interpretation by different users which may affect its usage at Malaysian HE level. Therefore, this research aimed at addressing these criticisms by (i) determining the CEFR’s suitability, (ii) identifying fundamental elements towards localisation, and (iii) developing a framework for CEFR localisation that conforms to local context through a case study design using the tenets of Language Management Theory. This study engaged 10 participants from 6 different public universities in Malaysia. The participants were all academic staff having had experience teaching writing in English to tertiary level students. Data was collected through 4 research instruments: (i) rating sheets, (ii) rater pro forma, (iii) individual semi-structured interviews, and (iv) a semi-structured questionnaire. The gathered data were then accordingly analysed or transcribed for further analysis, and the emerging themes were categorised and discussed in detail. The findings revealed that academics at Malaysian HE level found the CEFR perplexing and have voiced concerns of its introduction. It was also revealed that academics preferred if the CEFR could be localised to local higher education context. As such, data that was acquired from the rater pro forma, as well as the semi-structured interviews provided the basis for localisation. A post localisation rating exercised demonstrated that the localised CEFR descriptor yielded better rating consistency measured through an intraclass correlation coefficient (ICC) (ICC = .951) in comparison to the available CEFR written production illustrative descriptor (ICC = .747). Additionally, the available data that was acquired also provided the basis for the conceptualisation of a localisation model that could be applied to other localisation attempts. This study also provided crucial implications for Malaysian policy makers at the supra macro planning level, as well as for those at the micro levels as the success of a language policy implementation is dependent on actors from both planning levels. Moreover, suggestions for further studies were also presented should other researchers be interested to continue with this research.