77 Saša jošt, Andrej Stopar Perception of Foreign Phonemes: The Case of Slovene Students of English t HE So UNd S o F ENGLISH Self‑ Assessment of the Sounds of the English Language that Pre‑ Service EFL T eachers Consider Problematic to Pronounce AbStr Act The article presents and discusses a mixed-method study that aimed at establishing how pre-service teachers of English as a Foreign Language (EFL) self-assessed those sounds of the English language that would cause problems for their pronunciation in EFL. Fourteen pre-service EFL teachers on the intermediate level of EFL proficiency whose first language (L1) was Norwegian were recruited for the study. They were asked to write reflective essays concerning the sounds of the English language that they considered problematic to pronounce. The participants’ essays were contrasted with the essays written by the control group that was comprised of 14 in-service EFL teachers whose L1 was Norwegian. The results of the analysis revealed that the participants identified several English sounds that they self-assessed as problematic to pronounce, e.g. /z/, /ð/, /θ/, and /ʌ/. The analysis of the controls’ essays yielded similar results. These findings and their linguo-didactic implications are discussed in the article. Keywords: English as a Foreign Language (EFL); pre-service EFL teachers; pronunciation; self-assessment; sounds of the English language Glasovi angleščine, ki jih bodoči učitelji angleščine samoocenjujejo kot težje izgovorljive Pov ZEt EK Članek predstavlja študijo, ki z mešano metodo ugotavlja, kako bodoči učitelji angleščine kot tujega jezika samoocenjujejo angleške glasove, ki se jim zdijo težje izgovorljivi. v raziskavi sodeluje 14 bodočih učiteljev angleščine na srednji stopnji znanja angleščine, katerih prvi jezik je norveščina. Udeležence smo prosili, naj zapišejo svoje misli o angleških glasovih, ki se jim zdijo težje izgovorljivi. Njihove zapise smo primerjali z zapisi kontrolne skupine, ki jo je sestavljalo 14 učiteljev angleščine kot tujega jezika, katerih prvi jezik je prav tako norveščina. r ezultati razčlembe so razkrili, da so udeleženci našteli več angleških glasov, ki so jih ocenili kot težavne, npr. /z /, /ð/, /θ/ in /ʌ/. Analiza kontrolne skupine je pokazala podoben rezultat. Prispevek razčleni te ugotovitve in njihov jezikovno-didaktični pomen. Ključne besede: angleščina kot tuji jezik; bodoči učitelji angleščine kot tujega jezika; izgovarjava; samoocenjevanje; glasovi angleščine Oleksandr Kapranov Western Norway University of Applied Sciences, Norway 2018, vol. 15 (2), 77–99(164) revije.ff.uni-lj.si/elope doi: 10.4312/elope.16.1.77–99 Udc: 811.111'243 :81'355 78 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... 1 Introduction This article presents and discusses a mixed-method study of English sounds that pre- service teachers of English as a Foreign Language (EFL) whose first language (L1) is Norwegian consider problematic to pronounce. From a theoretical perspective, this study is embedded into the general theme of the present journal volume, namely the investigation of how the sounds of English are addressed in research, EFL learning and teaching, and self-assessment of pronunciation in EFL. The following two notions are central in the present study: i) self-assessment in the context of foreign language (FL) teaching and learning, and ii) the notion of pronunciation difficulties by EFL students. In the study, self-assessment is regarded as “one’s own evaluation of one’s performance or capabilities” (d olosic 2018, 194). The notion of pronunciation difficulties by EFL students is operationalised in this study as a range of those English sounds and suprasegmental units that EFL learners consider challenging to pronounce. Self-assessment is amply reported in scientific research in education (boud 2013; Harris 1997; o scarson 1989) and applied linguistics (cieślicka and r ojczyk 2017; d olosic 2018; Kapranov 2015; Lintunen 2013; Saito 2011; Szpyra-Kozłowska 2011; Szyszka 2011). Previous research indicates that self-assessment plays an important role in learning (boud 2013; Liu and b rantmeier 2019). In this regard, boud (2013) notes that students are able to self-assess the process and outcomes of their own learning. Self-assessment facilitates the students’ awareness of and responsibility for their own learning (boud 2013; dlaska and Krekeler 2008; Liu and b rantmeier 2019). boud (2013) posits that self-assessment involves the development of knowledge and a learner’s awareness of the existing standards in the field of learning, as well as the capacity to reflect upon whether or not the learner meets these standards (boud 2013, 12). In concert with boud (2013), Lappin‐Fortin and r ye (2014, 301) argue that self-assessment is a robust tool in FL teaching and learning, since it appears to increase the students’ motivation and FL awareness (Lappin-Fortin and r ye 2014). A similar approach to self-assessment is proposed by o scarson (1989), who demonstrates that self-assessment is involved in learning and the students’ awareness of learning goals (o scarson 1989, 3–5). In unison with o scarson (1989), dlaska and Krekeler (2008) argue that self-assessment facilitates student-centred learning, provides insight into the learning process, stimulates pro-active learning, and supports students in identifying those sounds of the foreign language that they consider problematic to pronounce (dlaska and Krekeler 2008, 508). These ideas map onto a definition of self- assessment as “the involvement of students in identifying standards and or criteria to apply to their work and making judgements about the extent to which they have met these criteria and standards” (boud 2013, 11). In applied linguistics, self-assessment is defined as self-regulatory behaviour that is guided by the students’ beliefs concerning how they can control their learning and increased awareness of the learning process of Self‑Ass essment of the Sounds of the English Language ... 79 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... their second language (SL) and/or FL (Sweet, Mack, and o livero-Agney 2019, 177). It should be noted that the terms “self-assessment”, “self-evaluation”, and “self-ratings” are regarded as synonyms in the present article, in accordance with the prior studies conducted by boud (2013), and dlaska and Krekeler (2008). Self-assessment is associated with a certain number of roles and functions (boekaerts 1997). In didactics and pedagogy, in particular, self-assessment is regarded as a means of goal-setting, as a constituent part of a language diagnosis system, as well as a part of the learner’s portfolio (o scarson 2013, 2). Following o scarson (2013), self- assessment in the present study is deemed to be a part of the learner’s self-diagnosis system. However, it should be made explicit that self-assessment as a self-diagnosis system is subjective (Szpyra-Kozłowska and Stasiak 2010). As with any subjective judgement, self-assessment is thought to involve inaccuracies and learners’ inflated ratings concerning their performance in an FL ( trofimovich et al. 2016). Extending o scarson’s (2013) approach to self-assessment, it seems reasonable to suggest that self-assessment is characterised by a metacognitive function (Flavell 1979). According to d ettori and Lupi (2013), the metacognitive function of self- assessment is manifested by the learners’ knowledge about knowledge, i.e. the learners are able to identify their knowledge gaps, and to distinguish factors and variables that affect the learning outcomes (d ettori and Lupi 2013). From the vantage point of metacognition, self-assessment is seen as “a key learning strategy for autonomous language learning, enabling students to monitor their progress and relate learning to individual needs” (Harris 1997, 12). In relation to EFL oral skills, the metacognitive function of self-assessment is exemplified by the learners’ awareness of those individual sounds and/or suprasegmental units that cause difficulties in EFL pronunciation (d ettori and Lupi 2013). As previously mentioned, another central notion in the present research involves those English sounds that intermediate EFL learners consider difficult to pronounce. Prior literature in applied linguistics and EFL studies indicates that there is a range of variables that are associated with the degree of difficulty that EFL learners might experience in their speech production in EFL (Huang and radant 2009; Khamkhien 2010; Lintunen 2013; o hata 2004; Saito 2014; Szpyra-Kozłowska 2011). Specifically , these variables involve the learner’s L1, age of acquisition, EFL exposure, phonetic ability, attitude towards the acquisition of correct pronunciation, motivation, and the level of anxiety (Khamkhien 2010; Szyszka 2011). Presumably, these variables, especially the learner’s L1, map onto the EFL learner’s ability to pronounce the sounds of the English language correctly (Saito 2014). It is inferred from the current research literature that the learner’s L1 is theorised to have a substantial impact upon potential difficulties EFL learners might encounter in terms of pronunciation of certain sounds of the English language (o hata 2004; Saito 2014). In this regard, Huang and radant 80 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... (2009) argue that “EFL language learners are likely to encounter difficulties when pronouncing sounds that do not exist in their first language” (Huang and radant 2009, 116). Specifically, on the intermediate level of EFL proficiency phonetically difficult words and sounds pose significant challenges that involve “intelligibility, comprehensibility, foreign-accentedness and acceptability judgements” (Szpyra- Kozłowska 2011, 286). Previous research is indicative of the importance of “the proper understanding of the mechanisms that lie behind such serious errors which contribute to the phonetic difficulty of words” (Szpyra-Kozłowska 2011, 287) and individual English sounds that EFL learners tend to associate with difficulties. Informed by the notions of self-assessment and the English sounds that are potentially difficult to EFL learners, the present study seeks to identify those English sounds that pre-service EFL teachers whose L1 is Norwegian (henceforth – ‘participants’) consider difficult to pronounce. The identification of the sounds is executed by means of the participants’ self-assessment. Given that there is little research on the topic of self-assessment of the English sounds that pose difficulties to pre-service EFL teachers whose L1 is Norwegian (Hopland 2016), this study aims to establish a repertoire of those difficult sounds. Additionally, the study seeks to juxtapose the participants’ repertoire of the difficult English sounds with those of the in-service EFL teachers. In particular, a group of in-service EFL teachers whose L1 is Norwegian has been asked to provide expert judgement concerning those English sounds that pose challenges to an average Norwegian L1 EFL learner on the intermediate level of EFL proficiency. The expert judgement approach follows Saito’s (2011) methodology “to elicit experienced L2 teachers’ opinions to determine learners’ problematicity” (Saito 2011, 365). It is hypothesised in the present study that the juxtaposition of the participants’ and the in-service EFL teachers’ repertoires would be indicative of a range of the English sounds that both these groups subjectively evaluate as problematic and challenging to Norwegian L 1 intermediate EFL learners. Further, this article is structured as follows. First, I will outline recent research publications that are associated with self-assessment of pronunciation difficulties in EFL by EFL learners from a variety of L1 backgrounds. Second, I will introduce the present study and discuss its findings. Third, the article will be concluded with linguo-didactic implications that would be relevant to the teaching and learning of EFL pronunciation to those EFL learners whose L1 is Norwegian. 2 Self‑Assessment of Pronunciation Difficulties in EFL: Literature Review There is a growing line of research that focuses upon the application of self-assessment to the identification of pronunciation difficulties and associated variables experienced by EFL students (cieślicka and r ojczyk 2017; Kapranov 2015; Lintunen 2013; 81 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... Salimi, Kargar, and Zareian 2014; Szpyra-Kozłowska 2011; Szpyra-Kozłowska and Stasiak 2010; Szyszka 2011). These research studies involve EFL learners whose L1 is Farsi (Salimi, Kargar, and Zareian 2014), Finnish (Lintunen 2013), Korean (Kapranov 2015), and Polish (cieślicka and r ojczyk 2017; Szpyra-Kozlowska 2011; Szyszka 2011). In particular, Salimi, Kargar and Zareian (2014) aim at establishing a set of difficult English sounds that have been identified by a group of Farsi L1 ELF learners. They argue that Farsi L1 EFL learners predominantly experience problems with the English diphthongs, e.g. /au/ and /ә ʊ/. Additionally, Farsi L1 EFL students consider problematic those consonants that are absent from their L1, e.g. /w/, /ð/, and /θ / (Salimi, Kargar, and Zareian 2014). Similarly to Salimi, Kargar and Zareian (2014), Lintunen (2013) investigates EFL learners’ self-assessment of pronunciation problems in English. Lintunen (2013) seeks to compare subjective and objective modes of assessments of Finnish L1 advanced EFL learners’ pronunciation in order to establish the connection between self-assessment and the explicit teaching of EFL phonetics. The results of the study by Lintunen (2013) reveal that Finnish L1 EFL learners are aware of their problems associated with EFL pronunciation, and their awareness has increased through teaching. Lintunen (2013) argues that “consonants caused most of the problems for the subjects. The most problematic feature was the phonemic opposition /v/–/w/. In addition, the sibilants (excluding /s/), affricates and dental fricatives were among the most difficult phonemes” (Lintunen 2013, 3–4). Self-assessment is employed in Kapranov (2015) in order to investigate the evaluation of EFL speech fluency by Korean L1 advanced EFL learners, with the results showing that they self-assess this negatively (Kapranov 2015). The participants in the study (Kapranov 2015) indicate that there are several variables that impede their speech fluency in the English language, e.g. pronunciation, insufficient vocabulary, and limited exposure to EFL speaking contexts. However, the participants do not mention those particular English sounds that might appear problematic to Korean L1 EFL learners (Kapranov 2015). Self-assessment in relation to pronunciation difficulties experienced by Polish L1 EFL learners is a central concept in the studies conducted by cieślicka and r ojczyk (2017), Szpyra-Kozłowska (2011), Szpyra-Kozłowska and Stasiak (2010), and Szyszka (2011). In particular, cieślicka and r ojczyk (2017) examine how Polish L1 EFL learners self-assess their own accent in English. cieślicka and r ojczyk (2017) suggest that whereas the Polish L1 EFL learners’ general self-assessment of their pronunciation and accent is stable, they do not associate their problems with pronunciation with particular English sounds. Similarly to cieślicka and r ojczyk (2017), Szyszka (2011) has not found any specific English sounds that are seen as problematic by EFL learners. Instead, the participants in Szyszka (2011) indicate that 82 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... the major sources of pronunciation difficulties are associated with the suprasegmental units, consonants, and vowels. Szpyra-Kozłowska (2011) focuses upon self-assessment of phonetically difficult words by Polish L1 intermediate EFL learners. In particular, the study argues that the contrast /z/–/s/ poses challenges to the Polish L1 EFL learners. In addition, Szpyra-Kozłowska (2011) demonstrates that the learners experience difficulties with high front vowels, i.e. /i:/ and /ɪ /, and several liquids in one word, e.g. “rural”, “regularly”, etc. Szpyra-Kozłowska and Stasiak (2010) report a case of self-assessment of English pronunciation by Polish L1 EFL learners who have been exposed to a phonetic training course. Szpyra-Kozłowska and Stasiak (2010) indicate that the learners positively self-assess their correct articulation of various frequent words that they used to mispronounce. Furthermore, the learners’ positive self-assessment involves attention to the relationship between English spelling and pronunciation. As evident from the literature review, there is ample research concerning learners’ self- assessment of English sounds and suprasegmentals that account for their difficulties with EFL pronunciation and speech fluency. However, little is known about the self-assessment of difficult-to-pronounce English sounds by pre-service EFL teachers whose L1 is Norwegian. In the following section of the article, I will present a mixed- method study that addresses and examines this under-researched area. 3 The Present Study: Its Context and Specific Research Aims The present mixed-method study was contextualised within the course in English phonetics offered at a large university in Norway. The course was comprised of lectures and seminars that followed the topics described in the course book “English Phonetics for teachers” by Nilsen and r ugesæter (2015). The topics that were addressed during the course involved such chapters in the course book as “Sound Foundation”, “consonants”, “ v owels”, and “The v arieties of Spoken English” (Nilsen and rugesæter 2015). Following cieślicka and r ojczyk (2017), the present study involved an assumption that the participants’ reflective essays on the topic “Sounds of the English Language that I consider Problematic to Pronounce” would be indicative of their difficulties with English pronunciation. Since all participants reported that they assessed their EFL students’ pronunciation during teaching practice sessions at school, it was hypothesised that the participants would self-assess their own problems with pronunciation in English. Specifically, it was hypothesised that by means of self- assessment the participants would identify a repertoire of English sounds that would be associated with a degree of difficulty. concurrently with that assumption, however, it was theorised in the study that the participants’ self-assessment could be subjective 83 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... and inflated, as indicated by trofimovich et al. (2016). Following that contention, it was decided to contrast the participants’ self-assessed repertoire of difficult-to- pronounce English sounds with that of the control group that consisted of in-service EFL teachers. Arguably, the comparison of those two repertoires would facilitate a deeper understanding of self-assessment in relation to those English sounds that were deemed difficult by Norwegian L1 intermediate EFL learners. based upon these assumptions, the following specific research aims were formulated: i) to identify a repertoire of English sounds that were subjectively self-assessed as causing problems in the participants’ speech production in EFL; ii) to identify a repertoire of English sounds that the controls subjectively perceived as posing difficulties to a typical Norwegian L1 EFL learner at the intermediate level of EFL proficiency; iii) to compare the aforementioned repertoires in order to establish which English sounds would be subjectively perceived as posing difficulties to an intermediate EFL learner whose L1 was Norwegian. 3.1 Participants The participants in the study were 14 EFL university students (11 females and three males) who were enrolled in the teacher training programme at a large university in Norway. All participants indicated that Norwegian was their L1 and English was their FL. The participants were deemed to be at an intermediate level of EFL proficiency that was referred to as the English b1 and b2 levels in accordance with the common EU framework of proficiency in a foreign language (The council of Europe 2011). The participants’ mean age at the time of the experiment was 23.5 years. There were no bilinguals among the participants. The control group consisted of 14 in-service EFL teachers (mean age = 44.5 years, mean duration of in-service teaching experience = 11.5 years) who were matched in terms of gender with the group of participants, i.e. 11 females and three males. The controls reported that Norwegian was their L1 and English was their FL. Analogous to the group of participants, there were neither bilinguals nor native speakers of English among the controls. All participants and their respective controls signed a consent form that allowed the author of the article to analyse their written data for scientific purposes. The participants’ and controls’ identities were coded to ensure confidentiality. The following codes were used in the study to refer to participants: P and the numbers from 1 to 14, e.g. P1, P2, … P14. The same coding procedure was applied to the control group. The controls were coded as c and the numbers from 1 to 14, e.g. c1, c2, … c14. 84 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... 3.2 The corpus The corpus consisted of the participants’ and controls’ reflective essays. The participants’ essays were on the topic “Sounds of the English Language that I consider Problematic to Pronounce”, whereas the controls were requested to write their reflections on the topic “Sounds of the English Language that Norwegian L1 Intermediate EFL Learners consider Problematic to Pronounce”. The application of computer program The Statistical Package for the Social Sciences (SPSS 2016) to the corpus yielded the descriptive statistics summarised in table 1 below: table 1. The descriptive statistics of the corpus. N Measure Participants Controls 1 total Number of Words 4299 5586 2 M Words 307 399 3 Std 48 167 4 Minimum 197 228 5 Maximum 392 923 M = mean; Std = standard deviation. 3.3 Procedure and Method The procedure in the study involved the following steps. First, the participants were asked to write reflective essays of approximately 300 words on the topic “Sounds of the English Language that I consider Problematic to Pronounce”. The controls were instructed to write reflective essays of 300 words on the topic “Sounds of the English Language that Norwegian L1 Intermediate EFL Learners consider Problematic to Pronounce”. It should be emphasised that the controls did not reflect on their own problems with the English sounds. Instead, they were specifically instructed to write their reflections on the possible range of English sounds that they thought would pose problems for an intermediate EFL learner whose L1 was Norwegian. The participants and their controls were given one week to write the essays. The participants and controls delivered their reflective essays to the author of this article via e-mail. In addition to the reflective essay, the participants were asked to transcribe two short texts in IPA, one text a month prior to the writing of the essay (see text 1 below) and another text (see text 2 in this subsection) one month after the essay. The participants were expected to use the so-called broad IPA transcription that presupposed that allophonic nuances (for instance, the dark /l/) could be omitted and/or ignored. The participants were given one week to transcribe each text, thus making it two weeks in total for the IPA transcription task. The participants were allowed to use 85 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... pronunciation dictionaries, study aids, and the Internet in this task. The final task the participants were asked to execute was the sit-in exam in English linguistics that involved functional grammar and phonetics. At the exam, the participants were instructed to transcribe a short text in English (see text 3 below) in IPA without any study aids, e.g. dictionaries, the course book, and online resources. The exam’s duration was approximately 6 hours. text 1. In 1904 an earthquake of magnitude 5.4 on the richter scale shook o slo, with an epicenter in the “o slo Graben” which runs under the Norwegian capital. There are now signs that indicate that we can expect a major future earthquake in o slo (IMdb 2018a). text 2. From the outer reaches of space to the small-town streets of suburbia, the hunt comes home. Now, the universe’s most lethal hunters are stronger, smarter and deadlier than ever before, having genetically upgraded themselves with dNA from other species. When a young boy accidentally triggers their return to Earth, only a ragtag crew of ex-soldiers and a disgruntled science teacher can prevent the end of the human race (IMdb 2018b). text 3. once upon a time, there was a famous musician. He met Anna, a struggling artist, who gave up on her dream to make it big as a singer. However, the famous musician decided to make her known all over the world. He wrote songs for her and went on tour with her. Soon, Anna’s career took off and she became famous in North America (IMdb 2018c). texts 1–3 were chosen for transcription in IPA based upon the following criteria: i) suitability. In particular, the texts were deemed suitable taking into consideration that they contained all English consonants and vowels; ii) an understandable topic that the participants could relate to. As pointed by Thomas (2014), EFL materials should be authentic, relevant, and understandable. All three texts chosen for transcription in IPA were film plot summaries taken from the Internet Movie d atabase (IMdb) site. Following Thomas (2014), film summaries were thought to be understandable and relevant to the participants. The participants’ reflective essays were manually examined by the author of this article for the explicit presence of those sounds that the participants self-assessed as posing problems and difficulties as far as their pronunciation in the English language was concerned. Similarly, the controls’ reflective essays on the topic “Sounds of the English Language that Norwegian L1 Intermediate EFL Learners consider Problematic to Pronounce” were manually investigated for the presence of the English sounds that the controls deemed problematic for an intermediate EFL learner whose L1 was Norwegian. The participants’ IPA transcriptions were 86 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... examined by the author of the article and by a lecturer in English, who served on the examiner’s board at a large university in Norway. The lecturer confirmed the results of the error analysis. 3.4 r esults The results of the mixed methods analysis yielded descriptive statistics that were summarised in tables 2–7. In particular, table 2 involved a summary of the participants’ self-assessed problematic sounds and the objective error analysis of the IPA assignments by the course teacher. table 2. The participants’ self-assessment of problematic sounds and the objective error analysis of the IPA assignments by the course teacher. N P Self‑Assessed Problematic Sounds Errors in IPA Assignment 1 Errors in IPA Assignment 2 Errors in IPA Assignment 3 1 P 1 /ð/ /θ/ /w/ - - - 2 P 2 /ð/ /θ/ /z/ /ð/ instead of /θ/ - /s/ instead of /z/ /a:/ instead of /æ/ /ə/ instead of /e/ 3 P 3 /z/ /ə/ /tʃ/ /ʌ/ instead of /ə/ /æ/ instead of /ə/ /s/ instead of /z/ /ʌ/ instead of /ə/ /ɒ/ instead of /ə/ /a:/ instead of /ə/ /s/ instead of /z/ /ʌ/ instead of /ə/ /ð/ instead of /θ/ 4 P 4 /ʌ/ /z/ /s/ /ð/ /θ/ /ə/ /ʌ/ instead of /ə/ - /s/ instead of /z/ 5 P 5 /z/ /tʃ/ /ʃ//ð/ /θ/ /θ/ instead of /ð/ - /ʌ/ instead of /ə/ /u:/ instead of /ə/ /ə/ instead of /e/ 6 P 6 /θ/ /z/ - - /u:/ instead of /ə/ 7 P 7 /θ/ /z/ /w/ /θ/ instead of /ð/ /ʌ/ instead of /ə/ /θ/ instead of /ð/ /ɒ/ instead of /ə/ /z/ instead of /s/ /s/ instead of /z/ 8 P 8 /θ/ /z/ - - /s/ instead of /z/ /ʌ/ instead of /ə/ /ə/ instead of /e/ 9 P 9 /z/ /ʌ/ instead of /ə/ - /v/ instead of /w/ /z/ instead of /s/ /ʌ/ instead of /ə/ /s/ instead of /z/ /ʊ/ instead of /ə/ 10 P 10 /z/ /s/ /s/ instead of /z/ /ɒ/ instead of /ə/ /ɒ/ instead of /ə/ /z/ instead of /s/ /a:/ instead of /ə/ 11 P 11 /z/ /ə/ /ɒ/ instead of /ə/ /ð/ instead of /θ/ /s/ instead of /z/ /ɒ/ instead of /ə/ /z/ instead of /s/ /ʌ/ instead of /ə/ 87 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... 12 P 12 /θ/ /w/ /z/ /s/ - /z/ instead of /s/ /z/ instead of /s/ /ʌ/ instead of /ə/ /ə/ instead of /e/ 13 P 13 /θ/ /z/ /s/ /ɒ/ instead of /ə/ - /ʌ/ instead of /ə/ /s/ instead of /z/ /z/ instead of /s/ 14 P 14 ð/ /θ/ /s/ /z/ /v/ /w/ /ɒ/ instead of /ə/ /ʌ/ instead of /ə/ /v/ instead of /w/ /ʌ/ instead of /ə/ /a:/ instead of /æ/ /a:/ instead of /ə/ Explanation of the abbreviations: P = participant. In addition to the difficult English sounds that were self-assessed by the participants, table 2 was comprised of the participants’ errors in three IPA transcription tasks. Those tasks are referred to as Assignment 1, Assignment 2, and Assignment 3 in table 2. It should be reiterated that the execution of Assignments 1–2 involved two weeks of preparation at home with the use of all available study aids, whilst Assignment 3 was an unprepared part of the sit-in exam without any access to course books, study materials, or the Internet. In contrast to the group of participants, the controls were instructed to write their reflective essays upon those English sounds that would typically cause problems for a Norwegian EFL learner at the intermediate level of EFL proficiency, i.e. the controls did not reflect upon their own problems with the difficult-to-pronounce English sounds. The results of the corpus of the reflective essays written by the controls are presented in table 3. table 3. The controls’ assessment of the sounds of the English language that pose problems for Norwegian L1 intermediate EFL learners. N Controls English Sounds that Cause Problems for Norwegian L1 Intermediate EFL Learners 1 c 1 /ð/ /θ/ /w/ 2 c 2 /ð/ /θ/ 3 c 3 /ð/ /θ/ /z/ 4 c 4 /z/ /tʃ/ /ə/ 5 c 5 /z/ /s/ /ð/ /θ/ 6 c 6 /z/ / θ / /tʃ/ 7 c 7 /θ/ /z/ /w/ 8 c 8 /θ/ /z/ /w/ /v/ 9 c 9 /θ/ /z/ /w/ 10 c 10 /z/ /s/ /ð/ /θ/ 88 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... 11 c 11 /z/ /ə//ð/ /θ/ 12 c 12 /z/ /s/ /w/ 13 c 13 /ð/ /θ/ /s/ /z/ /v/ /w/ 14 c 14 /ð/ /θ/ /s/ /z/ The mean number of sounds that caused problems for Norwegian L1 intermediate EFL learners is summarised in table 4 below. table 4. Sounds that caused problems for Norwegian L1 intermediate EFL learners (by group). N Measure Participants Controls 1 M sounds that cause prob- lems for intermediate EFL Learners whose L1 is Nor- wegian (per group) 3.2 3.5 2 Std 1.5 1 M = mean; Std = standard deviation. The percentages of those English sounds that were given in tables 2–3 was calculated in SPSS (2016), and the results are presented in table 5. table 5. The Percentages for the difficult sounds that the participants and controls consider problematic for Norwegian L1 intermediate EFL learners. N Difficult Sound Participants Controls 1 /ʌ/ 7% - 2 /ə/ 21% 14% 3 /s/ 36% 36% 4 /ʃ/ 7% - 5 /tʃ/ 14% 14% 6 /ð/ 50% 57% 7 /θ/ 71% 86% 8 /v/ 7% 14% 9 /w/ 29% 43% 10 /z/ 93% 86% tables 6–7 outlined the participants’ mean number of errors ( table 6) and the percentage of errors per group ( table 7) in the IPA transcription tasks. table 6. Errors in IPA transcription tasks performed by the participants N Measure Errors in IPA Assignment 1 Errors in IPA Assignment 2 Errors in IPA Assignment 3 1 M errors per group in the task 1 0.7 2.6 2 Std 0.8 1 1.3 M = mean; Std = standard deviation 89 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... table 7. The percentage of errors per group of participants in the IPA transcription tasks. N Error Percentage of Errors in IPA Assignment 1 Percentage of Errors in IPA Assignment 2 Percentage of Errors in IPA Assignment 3 1 /ʌ/ instead of /ə/ 29% 14% 50% 2 /a:/ instead of /æ/ - - 14% 3 /a:/ instead of /ə/ - - 21% 4 /æ/ instead of /ə/ 7% - - 5 /ə/ instead of /e/ - - 29% 6 /ɒ/ instead of /ə/ 29% 29% - 7 /s/ instead of /z/ 7% 14% 50% 8 /ð/ instead of /θ/ 14% - 7% 9 /θ/ instead of /ð/ 14% 7% - 10 /u:/ instead of /ə/ - - 14% 11 /ʊ/ instead of /ə/ - - 7% 12 /v/ instead of /w/ - - 14% 13 /z/ instead of /s/ - 7% 43% table 8 and table 9 below illustrate the participants’ and controls’ explanations and comments in the reflective essays that concerned the causes of the difficulties associated with the problematic English sounds. table 8. The participants’ comments and explanations concerning the causes of difficulties associated with the English sounds. N Participants The Participants’ Comments and Explanations 1 P1 “There is no similar English sound in Norwegian.” 2 P2 - 3 P3 “d ifferences between the native language and English…” 4 P4 “The difficult English sound is never used in Norwegian.” 5 P5 “The sounds that are difficult for Norwegian learners of English as a foreign language are typically sounds that are not used in the Norwegian language.” 6 P6 - 7 P7 “…the main reason for this is that we do not have the same or similar sounds in the Norwegian language. The /z/ sound can be a good example of this. This is a sound we do not use in Norwegian.” 8 P8 - 9 P9 “The first sound in English that I struggle with is the /z/ sound. It is a sound we don’t really use in Norwegian.” 10 P10 “I think it’s sometimes difficult to pronounce words that start with /v/ or /w/ because they sound like the same.” 90 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... 11 P11 “o ne of the sounds most Norwegians, myself included, struggle with is the sound /z/. This is due to the fact that /z/ doesn’t appear in the Norwegian language.” 12 P12 “English has different pronunciation and sounds which we cannot find in the Norwegian language. Thus, there are some sounds I find more difficult than others.” 13 P13 “Most of the sounds that can challenge a Norwegian language learner of English are sounds that don´t exist in the Norwegian language.” 14 P14 “The one that I struggle the most with is /q/. I think I find this sound really difficult to pronounce is probably because it is not used in Norwegian.” It should be noted that whereas table 8 presented the participants’ comments concerning their own problems and difficulties with the sounds of the English language and possible causes of these, the controls’ comments summarised in table 9 concerned intermediate EFL learners (in other words, in table 9 the controls did not comment on the variables that caused problems with pronunciation to themselves). table 9. The controls’ comments and explanations concerning the causes of difficulties associated with English sounds. N Participants The Controls’ Comments and Explanations 1 c1 “…my students tend not to round their lips when pronouncing an English /w/ as in why, were, when. Instead they use the Nor- wegian /v/. Again, it is said to be a Norwegian problem.” 2 c2 “Norwegians often seem to use Norwegian articulation when they speak English.” 3 c3 “o ne of the sounds my students find most problematic is /z/. I think it is a difficult sound to pronounce. We do not have that sound in the Norwegian language.” 4 c4 - 5 c5 - 6 c6 “A common mistake is to substitute the sound /ð/ with /d/. A reason that many Norwegians find this sound difficult to pro- nounce could be that the sound /ð/ is a dental fricative, and there are no dental fricatives in the Norwegian language…” 7 c7 “The English dental fricative sounds /θ/ and /ð/ are sounds we don`t find in the Norwegian language, so the students find them hard to pronounce…” 8 c8 - 9 c9 “Many Norwegian learners find it difficult to pronounce dental fricatives. In the Norwegian language, there are no dental frica- tives when it comes to consonants.” 10 c10 - 91 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... 11 c11 “I think that eloquent examples of difficult sounds come from words which are written in a completely different way than they are pronounced.” 12 c12 - 13 c13 “…my students tend to mix /v/ and /w/. The reason for this is that in Norwegian we pronounce words spelt with ‘w’ in the same way as those spelt with ‘v’.” 14 c14 “…[the sound] my students find most problematic is /z/. I think it is a difficult sound to pronounce. We do not have that sound in the Norwegian language.” 3.5 d iscussion As previously mentioned, it has been assumed in the study that the participants would self-assess their pronunciation difficulties associated with the sounds of the English language. The assumption involves the fact that the participants are pre- service EFL teachers who have experienced several sessions of teaching practice at school. consequently, it has been hypothesised that the participants would use their assessment skills they might possess as pre-service EFL teachers in order to self-assess their own problems with pronunciation in English. The results of the analysis of the participants’ reflective essays are indicative of the repertoire of English sounds that the participants associate with a degree of difficulty. As evident from table 2 and table 5, the participants’ repertoire of self-assessed difficult sounds in English consists of predominantly consonants (e.g., /z/, /θ /, /ð/, /s/, /w/, /tʃ /, /ʃ/, and /v/) and monophthongs (e.g., /ə /, /ʌ/). As seen in the data summarised in table 5, the participants’ most problematic sounds in the English language, e.g. /z/ (93%), /θ / (71%), and /ð/ (50%), are absent from their L1, Norwegian. In order to illustrate these findings, let us consider the following excerpt written by one of the participants. (1) The sounds that are difficult for Norwegian learners of English as a foreign language are typically sounds that are not used in the Norwegian language. Personally I have struggled with following phonemes: /θ /, /z/, /w/ and /v/ … /θ / as in three is a difficult sound because it does not exist in the Norwegian language. We have similar sounds, /t/ and /f/, and it is easy to replace the /θ / with one of these sounds. /z/ as in quiz is a difficult sound for the same reason as the /θ /: It simply does not exist in the Norwegian language. Norwegian students (including me) usually replace it with an /s/. What I find interesting is that the /z/ sound is usually not difficult to produce, but it is easily forgotten. Another difficult sound found in the word quiz is the /w/. Since /w/ is not found in the Norwegian language either, it is usually replaced with a /v/. As a result we end up with quiz being pronounced as [kvis]. (Participant P 5, female) 92 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... Excerpt (1) and the findings in table 5 support the literature (o hata 2004; Saito 2014) that emphasises the role of the learners’ L1 in their ability to pronounce English sounds of the English language correctly (Saito 2014). The analysis of the reflective essays written by the controls provides further support for the role of the Norwegian language in the learners’ difficulties with the English sounds. Specifically, the controls and participants assess as difficult those sounds that are absent from the phonological system of the Norwegian language (e.g., /z/, /θ /, /ð/, /w/, and /ə /), as well as the contrasts /s/–/z/ and /v/–/w/. These findings appear to be in concert with the prior research by Lintunen (2013), who finds that Finnish L1 EFL learners’ difficulties with the English sounds involve the phonemic opposition /v/–/w/ (Lintunen 2013, 3). Whereas Finish is not an Indo-European language, both Finnish and Norwegian lack a bilabial sound that is analogous to the sound /w/ in the English language. It is inferred from Lintunen (2013) that the difficulties with the contrasts such as /v/–/w/ are associated with the typological distance between Finnish and English. Similar to the observations found in Lintunen (2013), five out of 14 controls (36%) indicate that the main cause of the Norwegian L1 EFL learners’ difficulties is associated with those English sounds that have no equivalents in the Norwegian language. It is evident from table 8 and Figure 1 below that the majority of the participants (71%) share the same assumption concerning the cause of their difficulties with certain English sounds. FIGURE 1. The causes of difficulties of problematic sounds according to the participants and controls. Arguably, the findings shown in Figure 1 support previous studies that suggest that EFL learners “encounter difficulties when pronouncing sounds that do not exist in their first language” (Huang and Radant 2009, 116). These findings are further illustrated by excerpt 2, where a control indicates the following: (2) As an English teacher, I notice some difficulties that many Norwegian students, and adults, have. A person with a typical bad “Norwegian-English” or a student who starts to learn English often has difficulties with the sound /ð/. A common mistake is to substitute the sound /ð/ with /d/. A reason that many Norwegians find this sound difficult to pronounce could be that the sound /ð/ is a dental fricative, and there are no dental fricatives in the Norwegian language... (Control C 6, female) Whereas the participants (71%) and controls (36%) attribute the causes of difficult English sounds to the fact that these do not exist in the Norwegian language, the data analysis indicates that 14% of the controls appear to associate the causes of difficulties with the English spelling conventions. In addition, 14% of the controls suggest that Norwegian L1 learners of English use typical Norwegian articulation to produce English sounds. In contrast to the control group, the participants do not refer to articulation and spelling as the source of the difficulties associated with the English sounds. Notably, the participants do not make explicit comments concerning their problems with the transcription of the English texts in IPA (see Table 2 and Table 7). Presumably, the English spelling could have triggered errors in IPA transcriptions (see Table 2). However, it does not follow from the data that the participants seem to be aware of the English spelling as a variable involved in their difficulties with certain English sounds. Obviously, the correlation between the spelling and pronunciation difficulties merits further attention. However, it is beyond the scope of the present study to offer scientific generalisations concerning this issue, since it has not been referred to by the participants. Whereas the participants do not identify the English spelling as cause of their difficulties, 7% of them point to insufficient auditory discrimination as a cause of difficulties associated with the certain English sounds. In particular, one participant writes in her reflective essay that “I think it’s sometimes difficult to pronounce words that start with /v/ or /w/ because they sound the same” (Participant P 10, female). 0% 10% 20% 30% 40% 50% 60% 70% 80% The English sound is absent from Norwegian Insufficient auditory discrimination Norwegian articulation of the English sound English spelling Participants Controls Figure 1. The causes of difficulties of problematic sounds according to the participants and controls. Arguably, the findings shown in Figure 1 support previous studies that suggest that EFL learners “encounter difficulties when pronouncing sounds that do not exist in their first language” (Huang and radant 2009, 116). These findings are further illustrated by excerpt 2, where a control indicates the following: 93 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... (2) As an English teacher, I notice some difficulties that many Norwegian students, and adults, have. A person with a typical bad “Norwegian-English” or a student who starts to learn English often has difficulties with the sound /ð/. A common mistake is to substitute the sound /ð/ with /d/. A reason that many Norwegians find this sound difficult to pronounce could be that the sound /ð/ is a dental fricative, and there are no dental fricatives in the Norwegian language... (control c 6, female) Whereas the participants (71%) and controls (36%) attribute the causes of difficult English sounds to the fact that these do not exist in the Norwegian language, the data analysis indicates that 14% of the controls appear to associate the causes of difficulties with the English spelling conventions. In addition, 14% of the controls suggest that Norwegian L1 learners of English use typical Norwegian articulation to produce English sounds. In contrast to the control group, the participants do not refer to articulation and spelling as the source of the difficulties associated with the English sounds. Notably, the participants do not make explicit comments concerning their problems with the transcription of the English texts in IPA (see table 2 and table 7). Presumably, the English spelling could have triggered errors in IPA transcriptions (see table 2). However, it does not follow from the data that the participants seem to be aware of the English spelling as a variable involved in their difficulties with certain English sounds. obviously, the correlation between the spelling and pronunciation difficulties merits further attention. However, it is beyond the scope of the present study to offer scientific generalisations concerning this issue, since it has not been referred to by the participants. Whereas the participants do not identify the English spelling as cause of their difficulties, 7% of them point to insufficient auditory discrimination as a cause of difficulties associated with the certain English sounds. In particular, one participant writes in her reflective essay that “I think it’s sometimes difficult to pronounce words that start with /v/ or /w/ because they sound the same” (Participant P 10, female). As previously mentioned, the controls provided their expert judgements in order to determine intermediate EFL learners’ problematicity in the sense postulated by Saito (2014; 2011). Notably, it is evident from tables 2–7 that the participants and their respective controls share a common view concerning a range of English sounds that are deemed to be problematic. The participants’ self-assessment and the controls’ expert judgements are illustrated by Figure 2 below. As seen in Figure 2, the English consonant sounds /z/, /θ /, /ð/, and /w/ are perceived as the most problematic by the participants and controls. The high occurrence of these sounds is explicable by the absence of these or analogous sounds in the Norwegian language. These findings lend support to the previous research literature that emphasises the connection between the problematicity of an English sound for EFL learners and the learners’ L1 (Lintunen 2013; Szpyra- Kozłowska 2011). 94 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... As previously mentioned, the controls provided their expert judgements in order to determine intermediate EFL learners’ problematicity in the sense postulated by Saito (2014; 2011). Notably, it is evident from Tables 2–7 that the participants and their respective controls share a common view concerning a range of English sounds that are deemed to be problematic. The participants’ self-assessment and the controls’ expert judgements are illustrated by Figure 2 below: FIGURE 2. Difficult sounds in English according to the participants and the controls. As seen in Figure 2, the English consonant sounds /z/, /θ/, /ð/, and /w/ are perceived as the most problematic by the participants and controls. The high occurrence of these sounds is explicable by the absence of these or analogous sounds in the Norwegian language. These findings lend support to the previous research literature that emphasises the connection between the problematicity of an English sound for EFL learners and the learners’ L1 (Lintunen 2013; Szpyra-Kozłowska 2011). It is evident from Figure 2 that the participants self-assess the voiced fricative consonant /z/ as one of the most difficult English sounds. This finding supports previous research by Lintunen (2013) and Szpyra-Kozłowska (2011), who find that the contrast /z/–/s/ poses challenges to Finnish L1 and Polish L1 EFL learners, respectively. Moreover, the present findings provide indirect support to previous research that involves heritage speakers of Norwegian who reside in the USA (Haugen 1969; Moen 1988). Specifically, Moen (1988) reports a considerable number of errors related to the English fricative consonant /z/. Moen (1988) indicates that 46% of the first and second generation Norwegian Americans in the study substitute /z/ for /s/ in their oral communication in English. The participants’ subjective assessments of the voiced fricative consonant /z/ as a difficult sound are reflected in the objectively rated IPA transcription tasks, where the participants make a substantial number of mistakes that involve /z/. This finding is further exemplified by Figure 3 that illustrates the participants’ self-assessment of the problematicity associated with the English consonant sound /z/, the controls’ expert judgements concerning this sound, and the objective error analysis by the course teacher in the IPA task 3 (it should be remembered that this IPA task was executed by the participants without preparation and without any study aids). 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% /z/ /θ/ /ð/ /s/ /w/ /ə/ /tʃ/ /v/ /ʃ/ /ʌ/ par t ic ip ant s co nt rols Figure 2. d ifficult sounds in English according to the participants and the controls. It is evident from Figure 2 that the participants self-assess the voiced fricative consonant /z/ as one of the most difficult English sounds. This finding supports previous research by Lintunen (2013) and Szpyra-Kozłowska (2011), who find that the contrast /z/–/s/ poses challenges to Finnish L1 and Polish L1 EFL learners, respectively. Moreover, the present findings provide indirect support to previous research that involves heritage speakers of Norwegian who reside in the USA (Haugen 1969; Moen 1988). Specifically, Moen (1988) reports a considerable number of errors related to the English fricative consonant /z/. Moen (1988) indicates that 46% of the first and second generation Norwegian Americans in the study substitute /z/ for /s/ in their oral communication in English. The participants’ subjective assessments of the voiced fricative consonant /z/ as a difficult sound are reflected in the objectively rated IPA transcription tasks, where the participants make a substantial number of mistakes that involve /z/. This finding is further exemplified by Figure 3 that illustrates the participants’ self- assessment of the problematicity associated with the English consonant sound /z/, the controls’ expert judgements concerning this sound, and the objective error analysis by the course teacher in the IPA task 3 (it should be remembered that this IPA task was executed by the participants without preparation and without any study aids). As evident from Figure 3, 93% of the participants assess the English consonant sound /z/ as difficult. The errors that involve the incorrect use of /z/ by the participants account for 50% (/s/ instead of /z/) and 43 % (/z/ instead of /s/) in the IPA task 3. These findings appear to be in unison with the research study conducted by Haugen (1969), who posits that “The most persistent difficulty of Norwegian Americans is the inability to pronounce a proper z, especially at the end of words” (Haugen 1969, 48). 95 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... The participants’ problems with the English consonant sound /z/ are evident in the context of cumulative errors in all IPA tasks, as seen in Figure 4 below. It follows from Figure 4 that in addition to the errors that involve /z/ and the /s/–/z/ contrast, the participants experience difficulties with the English short monophthong /ʌ /, especially in the IPA task 3, and with the English neutral vowel /ə /. Whilst the short monophthong /ʌ / is absent from the Norwegian phonological system, the participants’ self-assessment of /ʌ / as problematic is not frequent (just 7% of the participants and none of the controls). FIGURE 3. The English consonant sound /z/ in the participants’ self-assessment, the controls’ expert judgements and the objectively rated errors in IPA Task 3. As evident from Figure 3, 93% of the participants assess the English consonant sound /z/ as difficult. The errors that involve the incorrect use of /z/ by the participants account for 50% (/s/ instead of /z/) and 43 % (/z/ instead of /s/) in the IPA Task 3. These findings appear to be in unison with the research study conducted by Haugen (1969), who posits that “The most persistent difficulty of Norwegian Americans is the inability to pronounce a proper z, especially at the end of words” (Haugen 1969, 48). The participants’ problems with the English consonant sound /z/ are evident in the context of cumulative errors in all IPA tasks, as seen in Figure 4 below. FIGURE 4. The percentage of errors in the IPA tasks per group of participants. It follows from Figure 4 that in addition to the errors that involve /z/ and the /s/–/z/ contrast, the participants experience difficulties with the English short monophthong /ʌ/, especially in the 0% 20% 40% 60% 80% 100% the participants self‐assessed difficulty the controls' expert judgement objectively rated error   /s/ instead of /z/ in the participants' IPA task 3 objectively rated error /z/ instead of /s/ in the participants' IPA task 3 0% 10% 20% 30% 40% 50% 60% task 1 task 2 task 3 Figure 4. The percentage of errors in the IPA tasks per group of participants. The participants’ self-assessed difficulty with the English vowel /ə / appears more frequent (21% of the participants). Even though the participants’ self-assessment of the difficulties related to /ə / seems less frequent in comparison with their self- assessment of other English sounds, especially /z/, it is, nevertheless, observed in FIGURE 3. The English consonant sound /z/ in the participants’ self-assessment, the controls’ expert judgements and the objectively rated errors in IPA Task 3. As evident from Figure 3, 93% of the participants assess the English consonant sound /z/ as difficult. The errors that involve the incorrect use of /z/ by the participants account for 50% (/s/ instead of /z/) and 43 % (/z/ instead of /s/) in the IPA Task 3. These findings appear to be in unison with the research study conducted by Haugen (1969), who posits that “The most persistent difficulty of Norwegian Americans is the inability to pronounce a proper z, especially at the end of words” (Haugen 1969, 48). The participants’ problems with the English consonant sound /z/ are evident in the context of cumulative errors in all IPA tasks, as seen in Figure 4 below. FIGURE 4. The percentage of errors in the IPA tasks per group of participants. It follows from Figure 4 that in addition to the errors that involve /z/ and the /s/–/z/ contrast, the participants experience difficulties with the English short monophthong /ʌ/, especially in the 0% 20% 40% 60% 80% 100% the participants self‐assessed difficulty the controls' expert judgement objectively rated error   /s/ instead of /z/ in the participants' IPA task 3 objectively rated error /z/ instead of /s/ in the participants' IPA task 3 0% 10% 20% 30% 40% 50% 60% task 1 task 2 task 3 Figure 3. The English consonant sound /z/ in the participants’ self-assessment, the controls’ expert judgements and the objectively rated errors in IPA task 3. 96 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... Figure 4 that the majority of their mistakes are associated with the incorrect use of /ə/. These findings are illustrated by Figure 5, which is based upon the participants’ self-assessment of the neutral vowel sound /ə /, the controls’ expert judgements, and the objective error analysis by the course teacher in the IPA task 3. IPA Task 3, and with the English neutral vowel /ә/. Whilst the short monophthong /ʌ/ is absent from the Norwegian phonological system, the participants’ self-assessment of /ʌ/ as problematic is not frequent (just 7% of the participants and none of the controls). The participants’ self-assessed difficulty with the English vowel /ә/ appears more frequent (21% of the participants). Even though the participants’ self-assessment of the difficulties related to /ә/ seems less frequent in comparison with their self-assessment of other English sounds, especially /z/, it is, nevertheless, observed in Figure 4 that the majority of their mistakes are associated with the incorrect use of /ә/. These findings are illustrated by Figure 5, which is based upon the participants’ self-assessment of the neutral vowel sound /ә/, the controls’ expert judgements, and the objective error analysis by the course teacher in the IPA Task 3. FIGURE 5. The English neutral vowel sound /ә/ in the participants’ self-assessment, the controls’ expert judgements and the objectively rated errors in the IPA Task 3. It is evident from Figure 5 that the participants make mistakes in the IPA Task 3 that involve several instances of incorrect representation of the English neutral vowel /ә/. Arguably, these mistakes are reflective of the participants’ problems with this sound that is absent from Norwegian. Notably, previous research (Cieślicka and Rojczyk 2017; Kapranov 2015; Lintunen 2013; Salimi, Kargar, and Zareian 2014; Szpyra-Kozłowska 2011; Szpyra-Kozłowska and Stasiak 2010) does not report EFL learners’ problems concerning /ә/. Other English sounds that are frequently evaluated by the participants and their controls as difficult are the interdental fricative consonants /ð/ and /θ/ (see Table 5), which are not represented in the phonological system of the Norwegian language. This finding is in unison with the study by Salimi, Kargar and Zareian (2014), who also report EFL learners’ self- assessed difficulties with /ð/ and /θ/ due to their absence in the learners’ L1. Additionally, this finding lends indirect support to Szpyra-Kozłowska (2011), who reports that Polish L1 intermediate EFL learners assess the combination of “/θ/ + a consonant” as challenging to pronounce. However, it is evident from the results in the present study that the participants’ subjective evaluation of the problematicity of the sounds /ð/ and /θ/ does not map onto multiple errors in IPA tasks. This finding is exemplified by Figure 6 below: 0% 10% 20% 30% 40% 50% 60% the participants self‐assessed difficulty the controls' expert judgement /ʌ/ instead of /ə/  /a:/ instead of /ə/  /u:/ instead of /ə/ /ʊ/ instead of /ə/ Figure 5. The English neutral vowel sound /ə / in the participants’ self-assessment, the controls’ expert judgements and the objectively rated errors in the IPA task 3. It is evident from Figure 5 that the participants make mistakes in the IPA task 3 that involve several instances of incorrect representation of the English neutral vowel /ə /. Arguably, these mistakes are reflective of the participants’ problems with this sound that is absent from Norwegian. Notably, previous research (cieślicka and r ojczyk 2017; Kapranov 2015; Lintunen 2013; Salimi, Kargar, and Zareian 2014; Szpyra- Kozłowska 2011; Szpyra-Kozłowska and Stasiak 2010) does not report EFL learners’ problems concerning /ə /. o ther English sounds that are frequently evaluated by the participants and their controls as difficult are the interdental fricative consonants /ð/ and /θ/ (see table 5), which are not represented in the phonological system of the Norwegian language. This finding is in unison with the study by Salimi, Kargar and Zareian (2014), who also report EFL learners’ self-assessed difficulties with /ð/ and /θ/ due to their absence in the learners’ L1. Additionally, this finding lends indirect support to Szpyra-Kozłowska (2011), who reports that Polish L1 intermediate EFL learners assess the combination of “/θ/ + a consonant” as challenging to pronounce. However, it is evident from the results in the present study that the participants’ subjective evaluation of the problematicity of the sounds /ð/ and /θ/ does not map onto multiple errors in IPA tasks. This finding is exemplified by Figure 6. 97 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... It is observed in Figure 6 that /ð/ and /θ/ do not seem to be associated with substantial errors in the IPA task 3. However, it should be noted that the interdental fricative consonants /ð/ and /θ/ have traditionally been regarded as problematic for Norwegian L1 speakers of English (Haugen 1969). j udging from the present data, the same argument can be applied to the approximant /w/, which is assessed as difficult by 29% of participants and 43% of controls. Similarly to /ð/ and /θ/, the approximant /w/ is not involved in numerous mistakes in the IPA tasks (14% errors in the IPA task 3 and no errors in other tasks). 4 Conclusions and Linguo‑Didactic Implications The study established that the application of self-assessment to the identification of difficult English sounds by intermediate EFL learners whose L1 was Norwegian resulted in a repertoire of English sounds that was similar to that of the control group. Their shared repertoire of the problematic English sounds consisted of predominantly consonants /z/, /θ /, /ð/, /s/, /w/, /tʃ /, /v/, and one neutral vowel /ə /. concurrently with those findings, it was found that whilst the participants and the controls assessed the sounds /ð/ and /θ / as highly problematic (e.g. 50% and 71% of the participants), the problematicity of those sounds did not map onto multiple errors in the IPA transcription tasks. In contrast, whereas the neutral vowel /ə / was not assessed by all the participants as difficult, it caused a significant number of errors in the IPA tasks. Since the study did not involve a substantial number of participants (N of participants = 14 and N of controls = 14, thus making it 28 in total), the results of the study should be treated with caution. Apart from the limited number of participants, another shortcoming in the study involved the lack of focus on the difficult-to- pronounce suprasegmental units. Arguably, an investigation of the Norwegian EFL FIGURE 6. The English inter-dental consonant sounds /ð/ and /θ/ in the participants’ self- assessment, the controls’ expert judgements and the objectively rated errors in the IPA Task 3. It is observed in Figure 6 that /ð/ and /θ/ do not seem to be associated with substantial errors in the IPA Task 3. However, it should be noted that the interdental fricative consonants /ð/ and /θ/ have traditionally been regarded as problematic for Norwegian L1 speakers of English (Haugen 1969). Judging from the present data, the same argument can be applied to the approximant /w/, which is assessed as difficult by 29% of participants and 43% of controls. Similarly to /ð/ and /θ/, the approximant /w/ is not involved in numerous mistakes in the IPA tasks (14% errors in the IPA Task 3 and no errors in other tasks). 4 Conclusions and Linguo-Didactic Implications The study established that the application of self-assessment to the identification of difficult English sounds by intermediate EFL learners whose L1 was Norwegian resulted in a repertoire of English sounds that was similar to that of the control group. Their shared repertoire of the problematic English sounds consisted of predominantly consonants /z/, /θ/, /ð/, /s/, /w/, /tʃ/, /v/, and one neutral vowel /ә/. Concurrently with those findings, it was found that whilst the participants and the controls assessed the sounds /ð/ and /θ/ as highly problematic (e.g. 50% and 71% of the participants), the problematicity of those sounds did not map onto multiple errors in the IPA transcription tasks. In contrast, whereas the neutral vowel /ә/ was not assessed by all the participants as difficult, it caused a significant number of errors in the IPA tasks. Since the study did not involve a substantial number of participants (N of participants = 14 and N of controls = 14, thus making it 28 in total), the results of the study should be treated with caution. Apart from the limited number of participants, another shortcoming in the study involved the lack of focus on the difficult-to-pronounce suprasegmental units. Arguably, an investigation of the Norwegian EFL learners’ difficulties with individual English sounds and suprasegmentals would be desirable. Nevertheless, the present study has several linguo-didactic implications that would be relevant to those pre-service EFL teachers whose L1 is Norwegian. These linguo-didactic implications are as followed. First, pre-service EFL teachers whose L1 is Norwegian should be provided with possibilities to use self-assessment as a means of identifying their problems with pronunciation in English, especially by means of reflection upon difficult-to-pronounce English sounds. Second, Norwegian L1 pre-service EFL teachers 0% 20% 40% 60% 80% 100% the participants self‐assessed difficulty the controls' expert judgement /ð/  instead of /θ/  /θ/ instead of /ð/ sound /ð/ sound /θ/ Figure 6. The English inter-dental consonant sounds /ð/ and /θ / in the participants’ self- assessment, the controls’ expert judgements and the objectively rated errors in the IPA task 3. 98 o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... learners’ difficulties with individual English sounds and suprasegmentals would be desirable. Nevertheless, the present study has several linguo-didactic implications that would be relevant to those pre-service EFL teachers whose L1 is Norwegian. These linguo-didactic implications are as followed. First, pre-service EFL teachers whose L1 is Norwegian should be provided with possibilities to use self-assessment as a means of identifying their problems with pronunciation in English, especially by means of reflection upon difficult-to-pronounce English sounds. Second, Norwegian L1 pre-service EFL teachers should pay specific attention to the English /s/–/z/ contrast, and, in particular, to the voiced fricative consonant /z/. Third, Norwegian L1 pre-service EFL teachers should be made aware of the distinction between the short monophthong /ʌ / and the neutral vowel sound /ə / in English. Acknowledgements The author of this article wants to acknowledge those pre- and in-service EFL teachers who took part in the study. Their participation is highly appreciated. References boekaerts, Monique. 1997. “Self-r egulated Learning: A New concept Embraced by r esearchers, Policy Makers, Educators, teachers, and Students.” Learning and Instruction 7 (2): 161–86. https://doi. org/10.1016/S0959-4752(96)00015-1. boud, d avid. 2013. Enhancing Learning through Self-Assessment. London/NY: r outledge. cieślicka, Ewa Grażyna, and Arkadiusz r ojczyk. 2017. “Self-r eported vs. Self-rated Pronunciation in a Non-Native Language.” Theory and Practice of Second Language Acquisition 3 (2): 69–86. d ettori, Giuliana, and v alentina Lupi. 2013. “Self-o bservation and Shared r eflection to Improve Pronunciation in L2.” In International Handbook of Metacognition and Learning T echnologies, edited by r oger Azevedo and v incent Aleven, 615–25. b erlin: Springer. dlaska, Andrea, and christian Krekeler. 2008. “Self-Assessment of Pronunciation.” System 36 (4): 506–16. https://doi.org/10.1016/j.system.2008.03.003. d olosic, Haley. 2018. “An Examination of Self-Assessment and Interconnected Facets of Second Language r eading.” Reading in a Foreign Language 30 (2): 189–208. Flavell, j ohn H. 1979. “Metacognition and cognitive Monitoring: A New Area of cognitive d evelopment Inquiry.” American Psychologist 34: 906–11. IMdb. 2018a. “Skjelvet.” Accessed 1 d ecember 2018. https://www.imdb.com/title/tt6523720/. —. 2018b. “The Predator.” Accessed 1 d ecember 2018. https://www.imdb.com/title/tt3829266/ plotsummary. —. 2018c. “A Star is born.” Accessed 1 d ecember 2018. https://www.imdb.com/title/ tt1517451/?ref_=nv_sr_1. Harris, Michael. 1997. “Self-Assessment of Language Learning in Formal Settings.” ELT Journal 51 (1): 12–20. https://doi.org/10.1093/elt/51.1.12. Haugen, Einar Ingvald. 1969. The Norwegian Language in America. A Study in Bilingual Behavior. bloomington: Indiana University Press. Hopland, Amalie A. 2016. “Spoken English in the classroom – A Study of Attitudes and Experiences of Spoken v arieties of English in English teaching in Norway.” MA thesis, University of b ergen. Huang, Hui-Ling, and j ames radant. 2009. “chinese Phonotactic Patterns and the Pronunciation d ifficulties of Mandarin-Speaking EFL Learners.” The Asian EFL Journal Quarterly 11 (4): 115–34. 99 tHE SoUNdS oF ENGLISH o leksandr Kapranov Self-Assessment of the Sounds of the English Language ... Kapranov, o leksandr. 2015. “Self-Evaluation of Speech Fluency in English as a Second Language by Korean Exchange Students Studying in Sweden.” In Language, Thought and Education: Exploring Networks, edited by Leszek Szymanski and Marek Kuczynski, 61–77. Zielona Gora: University of Zielona Gora. Khamkhien, Attapol. 2010. “Thai Learners’ English Pronunciation competence: Lesson Learned from Word Stress Assignment.” Journal of Language T eaching & Research 1 (6): 757–64. https://doi. org/10.4304/jltr.1.6.757-76. Lappin‐Fortin, Kerry, and b. j. r ye. 2014. “The Use of Pre‐/Posttest and Self‐Assessment tools in a French Pronunciation course.” Foreign Language Annals 47 (2): 300–320. https://doi.org/10.1111/flan.12083. Lintunen, Pekka. 2013. “The Effect of Phonetic Knowledge on Evaluated Pronunciation Problems.” In Proceedings of the Phonetics T eaching and Learning Conference, edited by j ohn A. Maidment, 55–58. London: UcL. Liu, Huan, and cindy b rantmeier. 2019. “‘I Know English’: Self-Assessment of Foreign Language r eading and Writing Abilities among Young chinese Learners of English.” System 80: 60–72. https://doi. org/10.1016/j.system.2018.10.013. Moen, Per. 1988. “The English Pronunciation of Norwegian-Americans in Four Midwestern States.” American Studies in Scandinavia 20 (2): 105–21. Nilsen, Thor Sigurd, and Kåre N. r ugesæter. 2015. English Phonetics for T eachers. o slo: Fagbokforlaget. o hata, Kota. 2004. “Phonological d ifferences between j apanese and English: Several Potentially Problematic Areas of Pronunciation for j apanese ESL/EFL Learners.” The Asian EFL Journal 6. o scarson, Mats. 2013. “The challenge of Student Self-Assessment in Language Education.” Voices in Asia Journal 1 (1): 1–14. —. 1989. “Self-Assessment of Language Proficiency: rationale and Applications.” Language T esting 6 (1): 1–13. https://doi.org/10.1177%2F026553228900600103. Saito, Kazuya. 2014. “Experienced teachers’ Perspectives on Priorities for Improved Intelligible Pronunciation: The case of j apanese Learners of English.” International Journal of Applied Linguistics 24 (2): 250–77. https://doi.org/10.1111/ijal.12026. —. 2011. “Identifying Problematic Segmental Features to Acquire comprehensible Pronunciation in EFL Settings: The case of j apanese Learners of English.” RELC Journal 42 (3): 363–78. https://doi. org/10.1177%2F0033688211420275. Salimi, Marjan, Ali A. Kargar, and Arash Zareian. 2014. “Self-Assessment of Pronunciation and Its Impact on EFL Learners’ Pronunciation Ability.” International Journal of Language Learning and Applied Linguistics World 6 (4): 605–22. SPSS. 2016. IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IbM corp. Sweet, Gabriela, Sara Mack, and Anna o livero-Agney. 2019. “Where Am I? Where Am I Going, and How do I Get There?: Increasing Learner Agency Through Large-Scale Self-Assessment in Language Learning.” In Foreign Language Proficiency in Higher Education, edited by Paula Winke and Susan M. Gass, 175–95. Switzerland: Springer. Szpyra-Kozłowska, j olanta. 2011. “Phonetically d ifficult Words in Intermediate Learners’ English.” In Speaking and Instructed Foreign Language Acquisition, edited by Mirosław Pawlak, Ewa Waniek- Klimczak, and j an Majer, 286–99. b ristol: Multilingual Matters. Szpyra-Kozłowska, j olanta, and Sławomir Stasiak. 2010. “From Focus on Sounds to Focus on Words in English Pronunciation Instruction.” Research in Language 8: 1–12. https://doi.org/10.2478/v10015-010-0012-7. Szyszka, Magdalena. 2011. “Foreign Language Anxiety and Self-Perceived English Pronunciation competence.” Studies in Second Language Learning and T eaching 2 (1): 283–300. The council of Europe. 2011. Common European Framework of Reference for Languages: Learning, T eaching, Assessment (CEFR). Accessed 1 j anuary 2019. https://www.coe.int/en/web/common-european- framework-reference-languages. Thomas, catherine. 2014. “Meeting EFL Learners Halfway by Using Locally r elevant Authentic Materials.” English T eaching Forum 52 (3): 14–23. trofimovich, Pavel, talia Isaacs, Sara Kennedy, and Kazuya Saito. 2016. “Flawed Self-Assessment: Investigating Self-And o ther-Perception of Second Language Speech.” Bilingualism: Language and Cognition 19 (1): 122–40.