Teaching Practicum in Kazakhstan
Поможем в ✍️ написании учебной работы
Поможем с курсовой, контрольной, дипломной, рефератом, отчетом по практике, научно-исследовательской и любой другой работой

Chapter 1

Introduction

 

Teaching Practicum in Kazakhstan

Teaching Practicum is compulsory for student teachers of graduate level enrolled in the English Language Teaching Department. Student teachers take Teaching Practicum at state schools, and follow the Teaching Practicum Curriculum issued by the Department of High Education of Kazakhstan. According to the foregoing Curriculum the Teaching Practicum consists of two periods: five-week period for the third-year students at the end of the 5th semester, December, and seven-week period for the fourth-year students at the beginning of the 7th semester, September and October.

Lesson observation is one of the major components of the Teaching Practicum. Both Teaching Practicums involve observation weeks: two weeks for the third-year students and one week for the fourth-year students. Observation weeks are devoted to observing lessons and familiarising with the school’s facilities, policies, procedures, pedagogical practices, and the preparation of timetable.

During the Observation Weeks student teachers have to observe lessons given by their monitor teachers to be aware of the methods and techniques of her/his teaching. In addition to it they observe the relationship between the teacher and students, students’ learning styles and their behaviour. To get better understanding of the learners’ personalities student teachers are recommended to observe lessons across other subject areas that are taught for the class they are allocated. At the same time pre-service teachers observe lessons of other experienced teachers who display exemplary teaching practices, and novice teachers to evaluate various teaching techniques at different levels of professional experience.

During the Observation Weeks student teachers are required to record their observations of fifteen English language classes for the third-year students and ten classes for the fourth-year students to be assessed. Students must have daily entries of their observations reflecting on various types of teaching or participation experience. Moreover, student teachers are strongly recommended to conduct peer observation and provide feedback on at least one lesson per day, and written feedback on at least two lessons per week during the Teaching Weeks.

 

The problem of assessment of observation documents

At the end of the Teaching Practicum observation sheets or diaries must be included in the Practicum Folder to be assessed. There is another problem a supervisor faces. There are no explicit criteria for assessment student teachers’ observation sheets. Gill S., a university teacher from the Czech Republic, in his feedback to my request about Teaching Practicum experience in different countries noticed: ‘What we use to arrive at these decisions (assess or not assess student’s observation schedules) is our internal and doubtless highly subjective criteria’. These criteria include the full answer to the questions, evidence of student teachers’ ability to describe what they have seen and link it to the activities of the lesson, evidence of reflection, and language explicitness. It is evident that all these criteria sound ambiguously. What should we treat as ‘the full answer’, ‘evidence of reflection’ and ‘language explicitness’? In my paper I am going to introduce scientific criteria for assessment of observation for research purpose and adapt them to observation as a learning tool for teacher training education.

 



Learner as a central focus of observation

Overview of chapters

 

The dissertation is intended to provide university supervisors and student teachers at Teaching Practicum with four observation tasks that are directed at observing learners’ behaviours.

Introduction explains the background situation in teaching practicum of TESOL Departments in High education in developing countries, particularly in the Kazakhstan Republic. I introduce the motives that have brought me the idea to develop materials for observation during the teaching practicum. The subsequent chapters have been divided into specific areas.

Chapter 2 gives a detailed account of observation in educational research and in the language classroom studies. Observation is defined as a direct research methods and a learning tool for data collecting. It emphasized characteristic features of observation as a scientific method and its difference from the natural process of looking. Some weaknesses of observation are specified, among which errors in representing data, objectivity of data recording and limitation of observable items are classified and described. Reliability and validity are two key processes that can enhance the ‘trustworthiness of reported observations, interpretations, and generalizations’ (Mishler 1990:419). Typology of reliability and evidences of validity introduce methodological strategies and judgment criteria for objective assessing of observation data. To ensure scientific observation an observer must clarify focus of observation, approach to data collection, and ways of recording observation data. The paper presents four perspectives on a lesson for pre-service teacher education: teacher-centred, learner-centred, curriculum-centred and context-centred focus. Two approaches (system-based, ethnographic) are described in opposition, and ad-hoc instrument as a combination of both. Method and techniques of observation focus on the main instruments that have been developed for pre-service teacher education: field notes, anecdotal records, diaries, journals, personal logs, case studies, and checklists, observation schedules, observation tasks, selective verbatim, rating numerical scales. They are classified as procedures of a low degree and high degree of explicitness (Seliger and Shohamy 1989:158) respectively. Data evaluation is a late and crucial stage in observation method. For teacher training education evaluation of observation records constitutes a part of the teaching practicum assessment. In qualitative and quantitative research two approaches to analysis of the documents are presented: manual and computer based. A set of procedures and criteria is specified for manual evaluation.

Chapter 3 describes the details of the learner observation tasks design. It explains the choice of area for learner observation and the reasons of modification of classroom observation tasks elaborated by Wajnryb (1992). Description of the task frame, categories is provided.

Chapter 4 gives self-evaluation account of the designed materials in the context of the literature review. It explains the choice of the ad-hoc approach as the most appropriate instrument for teacher training education. I emphasise the combined features of ethnographic and structured approach to the design of the learner observation tasks. It is followed by the evidences of reliability and validity of the documents.

Chapter 5 introduces a brief background about the particular facet of learner behaviour that is to be focused on doing every observation task. This is followed by the actual description of the task, its objectives and the procedure of the work on the task before, during and after the lesson. I explain the choice of categories and symbols of the task that student teachers are recommended to employ in their descriptive notes.

Chapter 6 indicates further implication of the learner observation tasks into the Teaching Practicum Curriculum. Also three phases how to work with the tasks are given for university supervisors. I have adapted evaluation criteria proposed by Scott (1990) for manual assessment of trainees’ documents. Finally, some recommendations for future improvement of assessment procedure with the use of computer packages are introduced.



Chapter 2

Literature review

 

What is observation?

 

Observation as a problem

Data recording problems

The problem of accurate recording

Data collection, description procedures face problems of the accuracy and explicitness of records. ‘The crucial problem is to be able to render interpretable the process of events and behaviour as it occurs naturally’ (McKernan 1996:60).

Hutt and Hutt (1970:34) emphasise the difficulty of accurate description of the behaviour. They emphasize the problem with the vocabulary choice in that there are many thousands of words which describe motor and language behaviour but ‘unfortunately, the words are injunctive concepts, learned by usage rather than by definition’ (Hutt and Hutt 1970:34). Other than that, it is frequently found that some definitions are over encompassing in that they cover patterns of behaviour for which ordinary language has two or more terms. Lofland and Lofland (1995:93) recommend employing behaviouristic and concrete vocabulary rather than abstract adjectives and adverbs, which are based on paraphrase and general recall.

The problem of objective recording

Another problem with the written commentary to be discussed is the problem of objectivity. All researchers agree that the data are often subjective, reflect personal impressions, inferential and interpretative. Events may not be viewed the same way by different observers. ‘It is common to find that witnesses to an accident give differing accounts of what happened’ (Lofland 1995:127).

Eisner (1993:49) defines objectivity as being ‘fair, open to all sides of the argument’. He considers that to reduce subjectivity the observer must achieve correspondence not only in what s/he perceives or understands but how she or he represents it. Schaffer (1982:75) continuous the problem of vocabulary choice saying that there are some aspects of reality which can be described fairly objectively and those which can only be described subjectively, and ‘it is difficult to know where the borderline between objectivity and subjectivity lies’. Scheurich (1997:161) doubts in ‘the very existence of gross material reality’. He claims that research mainly addresses interpretation of meaning or constructions of ‘reality’.

To sum the problems with data recording I can suggest that an observer may describe and interpret an event in subjective way due to personal bias, theoretical assumptions, s/he can experience difficulty in the choice of an object/behaviour to observe and words to record an event in accurate and explicit way.

 

Reliability and Validity

Types of reliability

Reliability and validity are the most important criteria for assuring the quality of the data collection procedures. The criterion of reliability provides information on whether the data collection procedure is ‘consistent and accurate’ (Seliger and Shohamy 1989:185). The researchers suspect that observers may unintentionally impose their own biases and impressions on the observed situation. Seliger and Shohamy (1985:185) claim that for different types of data collection procedures different types of reliability are relevant. Thus they determine for the ethnographic approach the following types:

a) inter-rater reliability (to examine to which different observers agree on the data collected from the observation);

b) test-retes reliability (to check stability of data collection over time);

c) regrounding (to repeat the data collection and compare both results);

d) parallel form (to examine to which extent two versions of the same data collection procedure are really collecting the same data)

To assure reliability different methodologists suggest involving at least two observers to carry a ‘sequential analysis’ (Becker 1970:79), or to achieve ‘inter-observer agreement’ (Croll 1986:150). The idea of the former procedure is to carry out the analysis concurrently with data collection in the sense that ‘one may ‘step back’ from the data, so as to reflect on their possible meaning’ (Fielding 2001:158). Thus further subsequent data gathering will direct the observer either to abandon or pursue the original hypothesis. In the later procedure two observers look at the same events from different locations to categorise these events and compare the outcomes. Using systematic schemes with pre-specified categories they refine, or ‘index’ (Fielding 2001:159) the definitions and categories of observation by ‘applying in a consistent manner the procedures for data selection, collection, grouping, inclusion, exclusion etc.’ (Simpson and Tuson 1995:65).

 

Items of observation

The importance of items

In so far the language classroom observation ‘does not simply mean watching classes’ (Wallace 1991:123). An observer may record either very narrowly defined data such as a specific speech act, or more general kinds of language learning activity such as turn-taking, group work.

Any scientific research or observation is characterised by terms as ‘structured’, ‘organised’, ‘methodical’, and ‘systematic’. To follow these characteristics any data collection obtains a structure or format, and guided by some questions or variables. Croll (1986:55) notifies a variable as a basic unit that represents the process by which a concept of interest is turned into a set of working definitions whereby the results of observation or some other data collecting process can be categorized and measured.

 

Typology of observation

 

Typology of classroom observation instruments is worked out by Wallace (1991:66) and he presents the following oppositions:

1. system-based, ethnographic or ad-hoc

2. global or specific

3. evaluative, formative or research-related

4. teacher-focused, learner-focused or neutral in focus

5. quantitative or qualitative

He admits that some of the oppositions are not clear-cut and overlap. For example, observation techniques which are primarily evaluative may be employed for formative purposes, ethnographic approach is treated as global and qualitative. System based approach can focus on teacher’s activity and learners’ activities. System-based (systematic), ethnographic and ad-hoc approaches encompass other characteristics of the classification provided. Thus, I outline the features of the first opposition.

 

System-based approach

By system-based observation Wallace (1991:67) means the observation that is based on a system of fixed and pre-specified categories. They are global in nature, i.e. ‘they are intended to give general coverage of the most salient aspects of the classroom process’ (Wallace 1991:110). Any system contains a finite array of categories. The endeavour of all system-based observation instruments is the analysis of teacher-class interaction. The two most influential systems are devised by Bellack (1966:267) and by Flanders (1970:314). Wallace (1991:112) has identified the characteristic features of the first system as:

1) the data are measured from a transcript, i.e. the data have to be first recorded and then transcribed;

2) the central place of labelled units of discourse are structure, solicit, response, reaction.

In the ‘Flanders tradition’ there is a form of documented recall where tallies are made every three minutes under one range of categories. In chapter 2.6 the analysis of a range of interaction schemes, their advantages and disadvantages are presented with more details. They are widely used by researchers as they are ready-made, well known and ‘it does not to be trialled and validated’ (Wallace 1991:111).

 

Ethnographic approach

The observation techniques share many of qualities of ethnographic practices. Ethnography is a detailed sociological observation of people which immerses the researcher in an intense period of observation ‘which guides and informs all subsequent data gathering’. (Radnor 2002:49)

Ethnographical approach is originally developed from the methodologies of field anthropologists and sociologists concerned with studying human behaviour within the context in which that behaviour would naturally occur. Methodologically, ‘anthropological’ classroom studies are based on participant observation, during which the observer immerse him/herself in the ‘new culture’. Initial data gathered by the ethnographer are open-ended and relatively unstructured that ‘allows and encourages the development of new categories’ (Delamont and Hamilton 1976:13). An ethnographer uses a holistic framework. S/he makes no attempt to manipulate, control or eliminate variables. At the same time s/he reduces the breadth of research problems systematically to give more concentrated attention to the emerging salient issues.

The great strength of the ethnographic research is that it gets away from the simplistic behavioural emphasis of the pre-specified codes. (Delamont and Hamilton 1976:37).

The main purpose of the ethnographic approach is the search for meaning and is based on the description of the studied phenomenon. However, Lutz (1986:112) warns that not everyone who can write a paragraph describing an encounter between a teacher and a student is an ethnographer, and he points out that an observer should be trained in ethnographic methods, particularly participant-observer field methods.

 

Ad-hoc approach

The term ‘ad-hoc’ is used to describe something that has been devised for a particular purpose, ‘with no claims to generality’ (Wallace 1991:113). The ad-hoc approach relates to structured approaches but the categories derive from a particular problem or research topic. That is why this system is more popular with practising teachers. What is more this approach is flexible and eclectic, and involves both quantitative and qualitative data where each seems appropriate. Wallace (1991:113) assumes that each different area of concern will yield a different system of analysis. Ad-hoc approach is considered to be the most appropriate in teacher-training education as it is basically guided discovery approach that drive student-teachers to focus and reflect on an important area of language teaching, and provide a meta-language with which to discuss. The instrument of ad-hoc approach is known as observation tasks (Wajnryb 1992) and is described in Chapter 2.6.2.

 

Observation instruments

Field notes

Field notes are records of naturalistic observation in the natural context of the behaviour researched through direct listening and watching. The main focus of observation notes is accurate description rather than interpretation. An observer can write down interesting details on various aspects of school life in general and of the teaching process in particulars. ‘Each observational note represents a happening or event – it approximates the who, what, when, and how of the action observed’ (McKernan 1996:94). McKernan considers field notes as a useful tool as

1. they are simple records to keep requiring direct observation

2. no outside observer is necessary

3. problems can be studied in the teacher’s own time

4. they can function as an aide-memoire

5. they provide clues and data not dredged up by quantified means.

At the same time an observer should consider some drawbacks in the use of this technique presented by McKernan (1996:96) as follows:

1. It is difficult to record lengthy conversations

2. They can be fraught with problems of researcher response, bias, and subjectivity

3. It is time-consuming to write up on numerous characters

4. They are difficult to structure

5. They should triangulate with other methods, as diaries, analytic notes.

The case study

Elliot and Ebbutt (1986:75) treat case study as a research technique in which teachers identify, diagnose and attempt to resolve major problems they faced in teaching for understanding. Richards (1998:73) considers case materials help students to explore how teachers in different settings ‘arrive at lesson goals and teaching strategies, and to understand how expert teachers draw on pedagogical schemes and routines in the process of teaching’. McKernan (1996:76) reminds that the researcher or an observer should use a ‘conceptual framework’, which can relate to existing science. So, the researcher employs various concepts to make sense of the observed data.

Richards (1998:76) enumerates advantages for using case studies in teacher education:

1. students are provided with vicarious teaching problems that present real issues in context;

2. students can learn how to identify issues and frame problems;

3. cases can be used to model the process of analysis and inquiry in teaching;

4. students can acquire an enlarged repertoire and understanding of educational strategies.

5. cases help stimulate the habit of reflective inquiry.

Diary/journal

Some research employ both terms equally. Allport (1942:95) has made the point that ‘the spontaneous, intimate diary is the personal document par excellence’. Many researchers have kept diaries as self-evaluative tool of their own experience. The most notable study of a diary keeping method is described by Bailey (1990). She has used the diary study approach as one option for the classroom-centered research project required in the practicum. The resulting journals have focused on issues related to lesson planning and creativity, time management, problems faced by non-native teachers of English, classroom control, group work, and difficult student-teacher relations. Baily's (1990:218) sense of result is that diaries were often extremely useful exercises for the teachers-in-preparation, both in generating behavioural changes and in developing self-confidence.

Requirements to write the diary entries she identifies as follows:

2. to set aside time each day immediately following the class, in pleasant place free of interruptions;

3. the time allotted to writing about the language teaching or learning experience should at least equal the time spent in class;

4. to set up the conditions for writing so that the actual process of writing is or can become relatively free. It's difficult in getting started;

5. in recording entries in the original uncensored version of the diary, one should not worry about style, grammar, or organisation. The goal is to get complete and accurate data while the recollections are still fresh.

Her studies reveal some problems in keeping diaries. In actual practice, students experience difficulties in describing events freely, the process of writing seems to be tedious for them; they do not get used to criticize, reflect, express frustration, and raise questions in written form. Some students were reluctant to edit their private journals.

Porter, Goldstein, Leatherman, and Conrad (1990:240) consider the journal is not a personal diary. They emphasise that the journal is a place to go beyond notes made during observation by exploring, reacting, making connections. The journal entries are intended to be polished pieces of writing. But as diaries, as journal are not assessed. The problem with assessment is in that there is no rigid regulation about the frequency of entries per day or week. It depends on the nature and structure of the course. At the same time writing every week is considered to be productive since the journal is meant to be ongoing. Sometimes students need to process what they are reading and make connections among a number of readings.

Benefits of using journals Porter et al. (1990:287) sees as:

1) students can get help with areas of course content where they are having difficulty; get a teacher’s response;

2) they promote autonomous learning, encouraging students to take responsibility for their own learning and to develop their own ideas;

3) students can gain confidence in their ability to learn, to make sense of difficult material, and to have original insights;

4) the journal encourages students to make connections between course content and their own teaching;

5) the journals create interaction beyond the classroom, both between teacher and student, and among students. It allows an ongoing dialogue between teacher and students;

6) the journals make class more process oriented. Students input can in part shape the curriculum. The teacher can use this information to restructure the course.

Anecdotal records

Anecdotal records McKernan (1996:67) refers to narrative-verbatim descriptions of meaningful incidents and events which have been observed in the behavioural setting. They focus on narrative, conversation and dialogue and provide short, sharp incisive summaries of points that stick in the mind after the event. Anecdotal records are treated to be useful in teacher training education because they directly observe behavioural data which enable students to ‘see’ the incident and gain ‘inside’ perspective. One of the key tasks for the observer is to watch for the beginning and ending of ‘episodes’ of behaviour. McKernan (1996:68) sets some disadvantages of anecdotal records that are similar to diary keeping and journal as any piece of descriptive writing, such as:

1. they require extensive time to observe, write and interpret;

2. maintainenace of ‘objectivity’ is difficult;

3. observers require training in the use of anecdotes;

4. they are often reported without taking accounts of setting;

5. read out of context, they can be misunderstood and misinterpreted;

6. some observers focus on ‘negative’ or ‘undesirable’ events only.

Personal action logs

Personal action logs McKernan (1996:110) defines as record sheets which document a researcher’s activities over a lengthy time period ‘to get a full-blown representation’ of a day. Thornbury (1991:141) clarifies the purpose of log-keeping as ‘to direct trainees’ attention towards areas they may have overlooked or avoided; to measure the trainees’ assessment against our own; to make adjustments, if necessary, to the course design and/or content’. Logs may be kept in chart summary form, describing the main events with time sampling or in a more descriptive form similar to a diary. At the same time personal logs (McKernan 1996:111) are recommended to keep over a lengthy period of time and in connection with more extensive accounts, such as field notes, diaries and audio transcripts to validate findings.

Check-lists

The use of check-lists suggests the formulation of well-defined and ‘clearly delineated behaviour categories, which in turn presupposes more than a superficial acquaintance with the data’ (Hutt and Hutt 1970:38). It is used to focus ‘the observer’s attention to the presence, absence, or frequency of occurrence of each point of the prepared list as indicated by checkmarks’ (Hopkins and Antes 1985:467). Thus a prerequisite for obtaining reliable and valid data from check-lists is a set of clearly defined categories. For this reason a check-list would be unsuitable for recording behaviour with which the observer was not completely familiar or for recording the complete range of activities in a free-field situation. The researchers confirm that although in principle a large number of categories are feasible, in practice an observer is unable to cope reliably with more than fifteen. Different methodologists notice that as the number of categories increase, the problems involved in scanning these. That is why Hutt and Hutt (1970:69) offer from a practical view to have check-lists as compact as possible, since they are most commonly used in those situations where the observer is attempting to record unobtrusively and with the minimum of distraction to the subject.

The greatest advantage of check lists is the facility and speed with which they can be analysed, as observer just ticks off phenomenon against an appropriate category by mere observation. Measures that might be easily obtained are as follows:

1. frequency with which there is a change in activity;

2. number of different activities;

3. number of stimuli encountered;

4. duration of specific activity;

5. changes in nature and duration of activities with time.

However, McKernan (1996:108) admonishes that the arrangement of the points is crucial in that sequence in task completion should be logical and sequential. An observer or designer of this instrument must ensure that:

1. points to be observed are listed in their actual sequence of happening;

2. all similar attributes are included in categories;

3. all the relevant and specified points are listed.

Observation schemes

Over the years numerous schemes have been developed for recording classroom interaction. Chaudron (1988:19), modifying the analysis originated by Long (1980), identifies twenty-four various schemes. In his review Chaudron (1988:17) points out that Long (1980) has included only those instruments which were designed to observe verbal interaction in a classroom, whereas the range of categories is great due to various purposes of observation. Chaudron interprets categories as

a) social interactive (Allwright (1980:169) turn-taking and turn-giving, Moskowitz’s (1970) ‘jokes’, ‘praises or encourages’)

b) pedagogical (Jarvis’s (1968:336) ‘classroom management’, ‘repetition reinforcement’, or Fanselow’s (1977:18) ‘solicit’, ‘respond’)

c) objective behaviour (Naiman, Neil, Frölich, Stern, and Todesco’s (1978) ‘student hand-raising’, ‘student callout’, or Moscowitz’s (1970) ‘student response -choral’)

d) semantic or cognitive content of behaviours (Fanselow’s (1977:31) ‘characterize’)

e) type and grouping of participants (Mitchell et al. (1981:19) ‘whole class’, ‘individuals doing the same task’)

For teacher training purpose Chaudron (1988:18) recommends to apply eleven schemes among which Capelle, Jarvilla, and Revelle (n.d.), Moskowitz’s (1970), Politzer (1980), Seliger (1977) are conducted in real time coding and categories of schemes refer to low degree of inference.

Advantages of interaction schemes as the basis of reflection in experiential knowledge are described by Wallace (1991:121) and he claims that these systems

1) objectify the teaching process;

2) provide a reliable record (by a trained observer);

3) promote self-awareness in the teacher;

4) provide a meta-language, which enables teachers to talk about their profession;

5) make teacher training more effective by improving the quality of teaching.

At the same time systematic observation schemes have some critics. Delamont and Hamilton’s (1976:3) main critique is levelled at the use of pre-specified categories to ‘code’ or classify the behaviour of teachers and pupils, which can not capture and reflect the whole complexity of classroom life.

Delamont and Hamilton (1976:8) identify seven criticisms of systematic observational systems:

1) Systematic observation provides data only about ‘average’ or ‘typical’ classrooms, teachers and pupils.

2) All the interactional analysis systems ignore the temporal and spatial context in which the data are collected as most systems use data gathered during very short periods of observation the observer is not expected to record information about the physical setting.

3) Interaction analysis systems are usually concerned only with overt, observable behaviour. In the case if intentions lay behind the direct behaviour an observer must himself impute the intention.

4) Interaction analysis systems are concerned with ‘what can be categorized or measured’ (Simon and Boyer 1986:1). They may obscure, distort or ignore the qualitative features which they claim to investigate, by having ill-defined boundaries between the categories.

5) Interaction analysis systems focus on ‘small bits of action or behaviour rather than global concepts’ (Simon and Boyer 1986:1). Delamont and Hamilton clarifies that there is a tendency to generate a superabundance of data which must be linked either to the complex set of descriptive concepts or to a small number of global concepts.

6) The systems utilize pre-specified categories.

7) Placing arbitrary boundaries on continuous phenomena obscures the flux of social interaction.

Walker and Adelman (1976: 136) emphasize the problems of recording child-child talk and objectivity of incorporating this kind of talk into the normal flow of teacher-centred classroom. They illustrate that there is no research instrument to code the spontaneous talk or social function of jokes and humour. ‘Talk is seen to be a highly complex, problematic activity, rich in contradictory and bizarre meanings and frequently with difficulties and confusions’ (Walker and Adelman 1976: 137). This organisation is taken for granted in observation schemes.

Rating scales

McKernan (1996:118) reviews various styles of rating scales – category, numerical, graphic and pictorial. They all share the common feature of having a rater place an object, person or idea along a sequential scale in terms of estimated value to the rater. Rating scales are treated as helpful instrument to measure non-cognitive areas where an observer is interested in cooperativeness, industriousness, tolerance, enthusiasm, group skills. At the same time McKernan (1996:119) notes that all rating sheets need to

a) include observable behavior;

b) rate significant outcomes as opposed to minor or trivial behaviours;

c) employ clear, unambiguous scales – never to use less than three, nor more than ten points on a scale;

d) arrange for several raters to observe the same phenomena to increase reliability of ratings;

e) keep items short and to the point.

Rating scales are opposed to direct observation as an assessment strategy. Nevertheless, Sattler (1982:33) points out that rating scale may not correspond with data obtained by the way of direct observation. He suggests that the internal consistency and ‘inter-rater’ reliability are important features of behaviour rating scales (Sattler 1982:34). Another criticism of observational data obtained through ratings is in that they involve human judgment and the sample of behaviour may be limited.

Selective verbatim

This technique is described by McKernan (1996:170). Unlike interaction analysis the selective verbatim techniques is directed at studying ‘selective’ verbal reactions. These are interactions that reflect effective or ineffective teaching. The procedure involves recording of the actual words and further analysis. The main advantage of the selective verbatim technique is in that it allows an observer to concentrate on one aspect of the teaching/learning behaviour at a time and it provides an objective non-interpretive record of verbal behaviour, which can be analyzed later.

Observation tasks

An observation task is ‘a focused activity to work on while observing a lesson in progress’ (Wajnryb 1992:7). Like a selective verbatim technique it focuses on one or a small number of aspects of the teaching/learning process but covers nonverbal behaviour as well. The purpose of the task is to collect actual facts or patterns of interaction that emerge in a lesson. The advantage of the collecting information with the help of selective tasks is that ‘it provides a convenient means of collecting data that frees the observer from forming an opinion or making a non-the-spot evaluation during the lesson’ (Wajnryb 1992:7).

To draw general conclusion about the techniques of observation I can say that some of them suggest either too broad or too narrow studying of the teaching process. It does not suit the main objectives of the Observation Weeks at the Teaching Practicum that are targeted to acquaint trainees with all the facets of the complex teaching/learning process gradually, to practice and develop trainees’ observation skills.



Evaluation of documents

Computer-based evaluation

Computer application in qualitative research analysis arguably brings some organisation and system into unstructured material and various paper forms, but definitely is helpful in storing and managing a large amount of materials in ethnography and statistics in quantitative data collection. Sophisticated software packages have been generated for the last years, for example, the Ethnograph (Seidel), QSR NUP∙IST (Richards and Richards), Hyper-RESEARCH (Biber, Kinder) ATLAS/ti (Muhr), SPSS. Computer programmes are of great help for a researcher and can assist in simple functions such as text processing and speed search as in more complicated ones: coding or indexing words and further retrieving them, building theories, making descriptive statistics and inferential one. But Gayle (2000) admonishes that a researcher should remember that computers do not produce results as such, they ‘merely take some of the laborious data management tasks away from the researcher’ Gayle (2000:415).



Chapter 3

Chapter 4

Chapter 5

Discussion

Classroom climate

‘Classroom’ and ‘social climate’ are two constituents of this notion.

 

Social climate

Emotional atmosphere and group cohesiveness

The term ‘social climate’ refers to the emotional atmosphere present in the classroom. Classroom climate can range from a non-threatening, supportive, free atmosphere, to classrooms where hostility, frustration, tension, and anxiety dominate all relationships.

In social and psychological studies the key tenet is the assumption that the emotional atmosphere, or ‘climate’, in which a group works, exerts a directive influence on behaviour and people’s relationship. In classroom situations where conditions of good climate exist, there is opportunity for students to express themselves freely; moreover, they work more cohesive as a social group. Group cohesiveness determines to a high degree the development of cognition of its members. This idea is traced in various learning theories, such as Vygotsky’s (1978) theory of social development, Bandura’s (1977) social learning theory, Johnson and Johnson’s (1989) theory of cooperative learning.

Group power and individual behaviour

Psychological studies of group behaviour have found that individuals behave differently in groups than they do when they are alone. ‘All groups posses a power to influence and establish their own norms of behaviour and attitudes within their community’ (Bany and Johnson 1964:39). What is more all groups tend to make members conform to these norms and values approved by the group. The values established by the group can vary in extremes. A group may display an atmosphere in which the members feel free because of prevailing kindness and friendliness. In another group, an atmosphere of suspicion, jealousy, or high competitiveness may exist. The kind of pressure that operates to influence individual behaviour can be overt and subtle. It can range from mild teasing to strong ridicule if the group member fails to conform. But an observer should take into account that a classroom group does not always give overt evidence of being a cohesive unity. Sometimes a quarrel over an incident that happened during the play period does not indicate the class group is not friendly, or a vigorous disagreement over group work shows a lack of solidarity. That is why every situation should be treated and reflected within a specific context.

 



The description of the task

The overall task (see Appendix 1) is targeted to raise awareness with student teachers about the factors that enhance positive classroom climate and classroom discipline respectively. The second task relates to gender differences in physical behaviour and attitude to each other, the teacher and the lesson in general. Another concern of the task involves studying students’ preferences for seats within different types of seating arrangements. The more advanced aim is to give student teachers a hint about the type of communication as well as the amount of communication that learners produce in different classroom arrangement.

This task is accomplished during the first meeting of a trainee with the class group. Student teachers are recommended to take a position aside from the pupils’ desks to notice facial expressions, emotions and any other physical motions every time the teacher attends to an individual or small group of learners. I have chosen the procedure of teacher’s attendance to learners as a measurement of learners’ behaviour. Although it does not indicate the frequency of occurrence of learners’ behaviour but it gives a student-teacher the idea about the techniques of classroom management, student-student, and teacher-students relationships in particular. For example, if a learner is doing another task different from the lesson objectives the teacher keeps the situation on alert and might attend to the pupil immediately.

A grid of learners’ seating arrangement should give student teachers a rough idea about the method that the teacher employs as it is described above. Gender indication is important as it provides a good picture of social climate and relationship, and teacher’s techniques of classroom management.

Student teachers are guided with some graphical symbols that reflect this or that physical behaviour which typically occurs in the classroom. At the same time pre-service teachers feel free in adding any other symbols for different behaviour than is indicated in the case if they notice during observation. I have introduced graphic symbols to put against every student on the grid without verbal description as symbolic indication is more feasible. This technique permits pre-service teachers to capture non-verbal behaviour that occurs very fast in real time. The system provides graphic symbols that are internationally recognised and comprehensive. Moreover, graphic symbolic indication simplifies the design and further analysis. Graphic symbols reflect concrete non-verbal behaviour and allow an observer to keep and recall the events that have happened during the lesson very easily. After the lesson student teachers have more time to describe the behaviour they observed in more precise words while reflecting on the influence of physical behaviour of students on the classroom climate.

Student teachers are guided with three additional tasks. They are recommended to make some field notices on the learner’s response to the teacher’s attendance. Fixing actual utterances that are produced by learners should promote further recollection of the type and the amount of language produced by the pupils in different positions. Another task provides the idea about learners’ behaviour and comfort while changing their positions. Pre-service teachers should capture the ‘action zone’ (Shamim 1996:123) of students where they feel free in movements without disturbing each other physically. Finally, student teachers are asked to notice and fix the behaviour of learners in two time intervals, at the beginning and at the end of working on the task in a new seating arrangement. In so doing student teachers should infer learners’ preferences for seating arrangement and the amount of time they can work together comfortably.

After the lesson student teachers are recommended to comment on all the tasks mentioned above immediately. During further post-observation discussion they continue their reflection on the relationship between seating arrangement and social climate in the classroom. Analysing gender-related differences in physical behaviour pre-service teachers will infer learners’ attitude to each other, the teacher and studying process in general. As it was mentioned above analysis of the type of utterances and their amount will lead student teachers to infer the influence of seating arrangement on learners’ involvement into the lesson and their progress in learning accordingly. Finally, student teachers will plan their future lesson in accordance with learners’ comfort and preferences for seating positions that provides effective classroom management and eventually enhances pupils’ learning progress.

 

Learner motivation

 

Types of motivation

Motivation is an internal drive that encourages somebody to pursue a course of action. If we define the goal and if that goal is sufficiently attractive we will be strongly motivated to do whatever is necessary to achieve that goal. A positive relationship between motivation and second language achievement is arguable among researchers but in general language teachers acknowledge that strongly motivated learners are easier to teach than those who have no such goals.

The best known categorization of motivation in language learning is the distinction between integrative and instrumental motivation. An integrative motivation involves an interest in learning foreign language because of ‘a sincere and personal interest in the people and culture represented by the other language group’ (Gardner 1985:6). The term ‘instrumental’ describes a situation in which students believe that mastery of the language has ‘some practical value and advantages of learning a new language’ (Gardner 1985:10). The language is treated as an instrument in their attainment of such a goal. Learners can, of course, have both integrative and instrumental motivation as it is impossible to separate two kinds of motivation in every situation of the learning process. Muchnick and Wolfe (1982:273) found evidences of both strong integrative and strong instrumental motivation in the same students.

 

Constituents of motivation

Constituents of integrative motivation

Motivation is ‘subjective experience’ (Good and Brophy 2000:217) that cannot be observed directly, but it can be inferred from students’ physical behaviour. The key dimensions that demonstrate strong motivation are ‘effort’ which learners put into their learning, ‘persistence’ with which learners continue doing their work in a determined way, and ‘activeness’ which is defined as frequency of participation in classroom contexts. But the first two variables demand high inferences from more observable learning behaviours such as working independently on the task for a long time, consulting with the teacher or the peer when uncertain, working at home with additional material, or display of hilarious emotion in response to the teacher’s reward. Although the relationship between frequent participation and second language achievement remains uncertain it clearly indicates interest to foreign language studying.

The choice of tasks according to the difficulty, the level of aspirations, the amount of effort exerted, and the persistence that learners displayed while working on the task reveals one of the variable of learner’s motivation, their sense of efficacy. As Dörney (1998:119) in his review of Bandura’s (1993) article asserts that people with a low sense of self-efficacy tend to dwell on the obstacles they encounter rather than concentrating on how to perform the task. In contrast, people with a strong sense of self-efficacy approach threatening situations with confidence, they are focused on the task rather than ‘self-diagnostic focus during task-involvement’ (Dörney 1998:120). Student teachers can easily infer this variable from overt learner’s cues on their immediate reaction towards the task they face; learners might complain and mumble about the difficulty, or they approach to the task immediately with or without accompanied exclamations about interesting challenge.

Constituents of instrumental motivation

Instrumental motivation variables are in some way more direct, and more observable. Learners’ attitude to teacher’s rewards and feedback make these variables salient. These variables link task performance to the product that students appreciate, and corresponds to the ‘expectancy + value’ theory (Feather, 1982:33) which holds that the effort students are willing to expend on a task is a product of ‘1) the degree to which they expect to be able to perform the task successfully, and 2) the degree to which they value those rewards’ (Good and Brophy 2000:221). Numerous researches confirm that students do not invest much effort in tasks that are not assessed and valued even if they know that they can perform the task successfully. But it must be admitted that rewards are more effective for increasing effort than for improving quality of performance. Moreover, most researchers agree that praise and rewards are motivating with routine work rather than novelty.

Commonly used types of rewards include: 1. material rewards; 2. activity rewards and special privileges (opportunity to play games, use special equipment); 3. grades, awards, and recognition (honour rolls, displaying good papers); 4. praise and social rewards; 5. teacher rewards (special attention, personalized interaction). Williams and Burden (1997:135) in their extensive review of research on the place of rewards in motivating people notice that material rewards gradually decrease interest in the activity. Whereas system of rewards set up as classroom management motivates towards good behaviour and positive changes, informational feedback rather than controlling is likely to increase motivation towards certain tasks as it enables learners ‘to identify specific aspects of their performance that are acceptable and capable of improvement … and helpful to them to move into the zone of next development’ (Williams and Burden 1997:136).

Finally, we should not deny the role of competition which is seen to be the predominant way to encourage learners to strive to improve their performance as the nature of competition with its prizes and rewards drives learners to volunteer an action and actively participate.

 

Description of the task

The aim of the task (see Appendix 2) is to raise awareness of student teachers about overall role of motivation in the learning process, and the degree of learners’ motivation to the learning process. Another aim is concerned with factors that are likely to exert a significant influence on learner’s willingness to make personal contribution to the task fulfillment and learning process in general.

This task is accomplished during the second meeting with the class after they have made their first impression about the pupils’ behaviour and relationship with each other and the teacher. Student teachers are recommended to observe six pupils of different gender and language level. The restricted number of target pupils will focus student teachers attention and makes the task more achievable, as they need some time to outline the learning situation and make some descriptive comments. Student teachers are free in choice of the number of female and male learners as it depends on specific a class. The number of female and male pupils can be equal or different.

Student teachers are guided with some observable evidences of low and high degrees of motivation. The choice of these signs reflects various factors that determine pupils’ commitment or lack of it. For example, the facts when a pupil ‘attends the task at once/ after the teacher’s reprimands’, ‘does not obey teacher’s instruction’ reveal pupils’ positive or negative attitude to the task, or the learning process. Observing the behaviour when a pupil ‘complaints about the difficulty of the task’, ‘enjoys working on difficult task’ student teacher can infer pupils’ sense of efficacy whether they under-estimate their capabilities or not. When a learner asks the teacher or his/her neighbour when uncertain it is likely to exert positive attitude to the task. But student teachers should be careful in labeling this desire as integrative or instrumental motivation since pupil responds to the teacher instruction, which might be formulated as getting a good mark, or interesting challenge. The fact when a learner works independently on the task for a long time demonstrates her/his effort invested in the task. But at the same time working for a long time seems to be ambiguous in determination this motivation as integrative or instrumental as it closely relates to students’ language competence, his/her attitude to the task and task instruction. So, student teachers are asked to comment on the manner of working on the task, and emotional behaviour. The fact when learners are glad or upset with teacher’s reward overtly displays pupil’s instrumental motivation, whereas attitude to the feedback should be treated in accordance with the context. Student teachers should judge whether negative or positive feedback is given and its effect on learner’s behaviour. It might raise positive emotions and hilarious exclamations, or frowning and mumbling on the part of learners. The last sign ‘pleas teacher to get a better mark’ is the salient evidence of instrumental motivation.

The frame of the task involves four columns. In the first column the names of learners should be put down beforehand. It allows student teachers to start their observation from the very beginning of the lesson. In the second column opposite the names of the target learners an observer makes some notes about physical, emotional and language behaviour. This task seems to be similar to the previous one. But this time student teachers have to be concerned with student’s willingness and interest to the task and learning process. In the third column student teachers have to outline a specific learning activity. After the lesson they will analyze which tasks promote negative or positive attitude with learners. In the last column an observer has to give any other comments on the situation and motives that caused this behaviour, and defines whether this situation refers to the instrumental or integrative motivation.

After the lesson pre-service teachers are recommended to make brief comments on the relationship between learners’ behaviour and learning activities in order to define which learning activities, instructions promote instrumental or integrative motivation. The third comment that students have to make concerns attitude to the task with different gender. They should be aware of whether motives of female and male students are different in approaching and accomplishing the tasks or the same.

At the post-observation session student teachers should reflect on the role of motivation in the learning process and its influence on the task fulfillment. They might think of the degree the pupils judge their learning capabilities, and the level they value their efforts invested in the task. It will direct pre-service teachers to take into account the degree of challenge pupils face and adequate feedback they expect. Finally, student teachers should consider all these factors in their further planning of lesson activities, formulating their instructions and anticipate appropriate rewards for every task.

 

Learner as a doer

Areas of learning styles

Reid (1995:x,xi) have grouped different dimensions of learning preferences into three main spheres: cognitive styles, sensory styles, affective/temperament styles. Cognitive learning styles refer to how people learn rather than what they learn. It relates to learners’ ‘habitual modes of processing information and, in a general sense, of organizing their perceptions of and interaction with their environment’ (Tudor 1996:108). Keefe (1979:4) defines learning style as a ‘characteristic of cognitive, affective, and physiological behaviors that serve as relatively stable indicators of how learners perceive, interact with, and respond to the learning environment’. Thus, the term ‘cognitive style’ is used to refer to a very complex set of processes, and encompasses various stylistic variables. The most famous and developed variable with application to language learning is field dependence – field independence (FD - FI). Sometimes called global versus analytical thinking this variable reflects on how learners think and process information. The FD learner is one who processes information globally. This learner is less analytical, not attentive to detail, and sees the perceptual field as a whole. This whole resists analysis or decomposition. The FI person on the other hand can easily break the field down into its component parts. S/he is typically not influenced by the existing structure and can make choices independent of the perceptual field. FD persons are more socially oriented, they ‘benefit from positive peer interaction’ (Violand-Sanchez 1995:53) and tend to be sensitive to approval (Chappel 1995:160). They also need more explicit instructions when material to be learned is disorganized. FI learner, because s/he does not need the approval of others, ‘might be the more confident language learner, actively speaking out in class and taking risks’ (Day 1984:74).

Sensory style refers to how people use their senses (seeing, hearing, touching, testing or smelling) in perceiving new information and materials. In learning context the first three of these senses dominate learners’ perception. That is why learning styles are often categorized to a person’s strongest sensory system: visual, auditory, and kinesthetic/tactile. Visually oriented learners prefer to read and to obtain information by means of visual stimulus; such learners react fast to stimulus provided by posters, flashcards and charts. Auditory learners are comfortable with oral teacher’s instructions, listening activities and discussions. Kinesthetic/ ‘hands-on’ (Oxford and Ehrman 1993:196) like lots of movement and enjoy working with tangible objects. These learners are good at dramatizing dialogues, playing games, especially which involve physical motions.

Affective learning styles involve temperament of a person. Temperament refers to basic dimensions of personality that are grounded in psychology and explain individual differences in the developmental process. Buss and Plomin (1984) developed a measure based on the following three dimensions: emotionality, activity, and sociability. One of the polar dimensions of affective learning style is extroverted-introverted style. Extroverted learners enjoy conversation, role-plays and other highly interactive activities. They are very expressive and speak a lot, but do not mind being interrupted. Whereas introverted learners are stimulated most by their own inner world of ideas and feelings. In the language classroom they prefer to work alone, listen carefully, but dislike interruption.

 

Description of the task

Although, learning style according to the foregoing definition is viewed as relatively fixed and non-changeable, Singleton (1989:157) argues that it is possible to help adult learners to explore their own preferences and to shape their learning approach to suit the requirements of a particular learning task. Thus the main goal of observational tasks (see Appendix 3) is to help student teachers to get to grips with pupils’ learning preferences, and thereby to be able to adjust teaching materials and respond to learners’ subjective needs in their future planning, and apply some techniques that can enhance natural learners’ capabilities, habits and develop other skills through training.

Student teachers are recommended to obtain information about learning styles during the third meeting with the group. This time pre-service teachers have to observe language and learning behaviour of students, which is accompanied by emotional and affective state. Linguistic behaviour comprises language production that is organisation of speech, complexity of utterances, pitch of intonation, and speed of production. Observing these variables student teachers can reveal affective styles of their learners. For example, if a learner produces utterances in a low voice without haste and emotions, an observer can assume that this learner refers to introverts and thus s/he requires patience to be listened to. Observing learning behaviour that is the way students approach and process a task, materials they use, manner of solving a problem, their social behaviour student teachers can obtain information about pupils’ cognitive and sensory styles. Trainees should notice whether a pupil uses additional aids such as pencils or fountain pens to highlight some information in the textbook, or whether s/he faces her/his partner during pair-, group work. These situations characterise a visual learner and a FD learner respectively with regard to Violand-Sanchez (1995) and Oxford and Ehrman (1993) research mentioned earlier.

Student teachers are given some examples which describe the language and learning behaviour, and the manner of approaching and processing a task. These examples cover all three groups of learning styles. It is noteworthy to mention that one example might comprise more than one learning style. Thus the characteristic ‘respond in a low voice but accurately’ might describe an introvert and FD learner, whereas ‘speaks fast but with errors’ includes features of an extrovert and FI pupil. But the expression ‘produces long utterances without haste and emotions’ may define an introvert but FI learner. Some examples display sensory preferences only. For example, the behaviour ‘highlight some passages with fountain pen or marker’ reveals a visual leaner, ‘gives the answer to the comprehension question after first listening’ is the feature of an auditory learner. The characteristic ‘volunteers to go to the blackboard’ displays the feature of a kinaesthetic learner but at the same time s/he might be an extrovert as well. Thus all these characteristics make student teachers be aware about the complexity of a child’s personality and give them a hint about affective, cognitive and sensory preferences of learners in accomplishing learning activities.

During the lesson student teachers are recommended to make notices in a chart with four columns: learning activity, name of learners, what and how learners do the activity, comment on the learners’ preferences. Columns are given in the sequence of the typical lesson and observational procedure: the activity is nominated by the teacher by giving instructions, then a learner either volunteers or is nominated by the teacher to fulfil the instruction, after it a student teacher observes the way of doing the activity, and finally s/he comments briefly about student’s manner of doing and infer learner’s preferences.

After the lesson a student teacher should discuss with the teacher and group students according to their learning preferences. This information will be very important for student teacher in their future planning of activities, in grouping of students particularly. They should take into account whether the activity presupposes grouping extrovert and introvert pupils together. The information about sensory preferences is important in planning the techniques to accomplish a task. If the number of visual learners prevails pre-service teachers should prepare some visual support to their oral instructions.

Later, during post observation session, student teachers are recommended to reflect whether learning activities and instructions that they have observed coincide to learners’ preferences. At the same time student teachers should consider the objectives of the lesson whether they were achieved successfully with or without catering for learners’ preferences. More advanced task for student teachers is to think about the learning activities which suit student’s natural learning styles and develop other skills through proper instructions.

 

Learner level

Description of the task

The main concern of the task (see Appendix 4) is to raise awareness of student teachers about the extent the task or activity match pupils’ level of capacities. Student teachers will observe the teacher-class interaction. In the case if there is an opportunity to observe and record pair-, or group- work students can make some notes of pupils’ language production as well.

Before the lesson pre-service teachers are recommended to consult with the teacher about the language and communicative level of pupils in the class. Full description of pupil characteristic about their language production and perceptive skills, communicative abilities might be time consuming. That it is why grades of pupils can be helpful as a rough measurement of pupils’ level of competence. At the same time an observer can judge objectivity of these grades while making records of actual pupil’s utterances.

During the lesson student teachers should observe language and communicative behaviour of pupils. The aspects of the language behaviour cover the accuracy in the use of grammar, and pronunciation, the size and organization of vocabulary (Meara 1996:37, 45), the complexity of grammar structures and construct of utterances; in so far communicative behaviour covers fluency of speech production, the choice and combination of ‘grammatical forms and meaning’ (Canale and Swain 1980:12), adequate initiation and response in actual performance.

At the lesson student teachers put down all the notices in the chart with five columns. The first two columns they should fill in before the lesson, where they fix the names of pupils in the class, and their grades provided by the teacher. In the third column an observer outlines the learning activities. It will help to recall the context and join learning activities with the teacher’s strategies. Later student teachers might refer to them as a sample in their own teaching practice. In the fourth column student teachers should fix concrete facts or evidences of the pupil’s level of competence, such as concrete grammar mistakes, mispronunciation, speed of production, or make some jotted notes of actual utterances. These records should help student teachers in their judgment about the level of pupil competence. Finally, in the last column student teachers are recommended to observe teacher’s strategies that s/he employs to adjust the learner level of comprehension. There are some examples of teacher’s strategies that are set before the chart. I have appealed to the ‘supportive’ (Millrood 2002:132) strategies mentioned above.

After the lesson student teachers are recommended to share their findings with the teacher and discuss the language behaviour of the learners whose level appears to be different from the designed before. An observer can present a fresh look at the situation and it should help to create new techniques and approaches that suit learner’s expectations and level. Another task for student teachers is to comment on the congruency of the student’s level of competence and the level of difficulty of the tasks. In the case if these levels do not coincide, student teachers should comment on the overt linguistic or communicative problems that pupils faced at the lesson.

At the post observation session students should reflect on the extent the task should be challenging for learners. Considering the data they have student teachers are recommended to contemplate over the appropriate activities and instructions that match learners’ levels and capacities and develop their progress in the language and communicative competence. Finally, pre-service teachers should reflect on the connection between learner’s social and physical position in the classroom, learner’s motivation, learning styles and learner level.



Chapter 6

Appendix 1

 

Classroom climate

Before the lesson:

1. Arrange to observe a lesson. Make sure you are seated in a position where you are able to observe students’ physical and emotional behaviour when the teacher attends to individuals.

2. Make familiar with the sample chart. Be aware that you will probably have to modify it.

During the lesson:

1. Make a grid of learners’ seating arrangement. Note on your diagram whether the students are male (M) or female (F).

e.g.

 

S1οM   S2ο M

 

S7ο F S8ο M
S3ο M(Phil) L S4ο F S9ο M S10ο F
S5ο F   S6ο M S11ο F(Angela) I S12ο F

 

2. Notice and put the symbols according to student’s physical or emotional behaviour every time the teacher attends to him/her. You may like to add others as you observe.

3. Try to record some field notes on student’s response to the teacher’s attending strategies.

4. Notice any changes in seating arrangement during the lesson.

5. Try to put symbols of physical behaviour when students attend to each other working in pairs or in a group at the beginning and the end of the task fulfillment.

¤ - eye contact with the teacher

I - hand raising

J - smiling

K - no emotions

L - boring

{ - daydreaming

² - doing another task different from the lesson objectives

B- physically bothering other students

m - other

After the lesson:

Comment on:

1. the seating arrangement, classroom discipline and social climate;

2. balance between teacher’s attendance to the students’ at the back and at the first desks;

3. balance between teacher’s attendance to female and male learners;

4. gender-related differences in physical behaviour;

5. comfort and attending to the task by the students at the first and the back desks;

6. the type and the amount of speech production by students at the first and the back desks;

7. any changes in students’ behaviour after seating arrangement was altered (if happened)

Reflect

What is the relationship between seating arrangement and social climate at the lesson? Does seating arrangement influence on classroom management?

How female and male learners’ behaviour is different?

What is the relationship between learners’ physical behaviour of different gender and their attitude to each other, the teacher and learning in general?

What is the relationship between location of students, and the type and amount of utterances they produce?

What is the relationship between seating arrangement and the nature of the learning process? (teacher-centred or learner-centred)


Appendix 2

 

Learner motivation

Before the lesson:

1. Arrange to observe a class.

2. Make yourself familiar with the chart below. Consider the evidences/signs of physical and language beahaviour that indicates students’ willingness and interest to the learning process. For example,

- asks the teacher when uncertain;

- attends the task at once;

- attends the task after the teacher’s reprimands;

- does not obey teacher’s instruction;

- enjoys working on difficult task;

- volunteers to participate in a competition (game);

- complains about the difficulty of the task;

- work(s) independently on the task for a long time;

- is glad with a teacher’s reward;

- is upset with the teacher’s feedback;

- presents additional material for home work;

- pleas teacher to get a good mark;

- other

You may wish to add some other signs.

3. Choose a range of six students of different gender and language level to comment on their motivation for learning.

During the lesson:

1. Consider these students’ behaviour in class and describe the learning activity in which this behaviour occurs. The far right column is for any other comments, such as the manner or emotional behaviour, whether the motivation is descried as instrumental, or integrative.

 

Student’s name Signs of high/ low motivation Learning activity Comment
Mark a) e.g. Finishes the task first   b) Filling the gap in grammar exercise The desire to get a good mark, as he enquires about the grade he can get, instrumental    
Peter a) e.g. volunteers the answer   b) Comprehension check after first listening Is fully involved into the lesson, integrative.

 

After the lesson:

1. Consider the data you have collected. Comment on the linkage between the columns 2 and 3.

2. Which learning activities enhance integrative motivation and which of them promote instrumental one?

3. Which type of motivation prevails with female and male pupils.

Reflection

How important is that the teacher should know different motivations of her students for learning the language?

How important is the role of feedback and rewards. What activities should be praised?

How do students judge their own learning abilities? Do they over- or under-estimate their capabilities? What is the degree they value their efforts to the learning activity.

How does students’ motivation influence on the task performance?

In what way might this data effects you when you plan a lesson with this group of learners?



Appendix 3

 

Learner as doer

Before the lesson

1. Arrange to observe language and learning behaviour of students at a lesson. Describe the manner of doing and materials they use. For example, students might

a. respond in a low voice but accurately;

b. speak fast but with errors;

c. produce long utterances without haste and emotions;

d. think for long time before giving the answer

e. highlight some passages with fountain pen or marker;

f. volunteer to go to the blackboard;

g. give the answer first to the comprehension question after first listening;

h. finish fill-in the gap exercise on the blackboard first;

i. face his partner during the pair-, group work;

j. use colloquial expressions in the cues;

k. volunteer to dramatize the dialogue

2. Think of the learner’s affective (extroversion, introversion), cognitive (Field-dependent, Field-independent), and sensory (auditory, visual, kinaesthetic) preferences in accomplishing learning activities.

3. Make yourself familiar with the chart below.

During the lesson

1. Observe the lesson from the point of view of what and how the learners actually do.

2. Make notes in the chart below.

- outline the learning activity;

- describe the action and the manner of doing;

- comment on learners’ preferences, for example, whether the learner is good at working independently, or in cooperation with the partner, receiving or producing the language.

 

Learning activity Learner’s name What & how learner does Comment on learner’s preferences
e.g. presentation of the dialogue Philip dramatizes a dialogue with emphatic intonation Enjoys and good at acting, prefers to produce language. FI, kinaesthetic  

 

After the lesson

1. Together with the classroom teacher group students according to their learning preferences.

2. Considering the data you have collected which activities in the lesson do you consider the most valuable for the learners? Explain your thoughts.

Reflect

What is the congruency between learners’ behaviour, preferences and learning activities?

To what extent the teacher should cater for learning preferences in planning a lesson? In what way learning activities can develop students’ learning styles?

Which approaches, materials, or techniques are you going to employ which suit student’s natural learning styles and can develop other skills in future planning of the lesson?



Appendix 4

 

Learner level

Before the lesson:

1. Arrange to observe a class.

2. Meet with the teacher and find out the learner’s language level. Have the student’s grade as a key. You might have made your assumptions about their level during previous observations.

3. Make yourself familiar with the chart below.

During the lesson

1. Look for overt evidence of the students’ level. Consider language competence (vocabulary, grammar, pronunciation), communicative competence (fluency of speech production, initiation, adequate response). Try to make records of students’ speech production.

2. In the far right column, record the strategies used by the teacher to adjust learner level. For example,

- varying speed of speech;

- varying complexity of language;

- varying length of wait time;

- calling on stronger students’ for ‘model’ answers;

- other

 

Student Level/grade Learning activities Signs of level Teacher’s strategies
Angela 3 vocabulary work; matching pictures and words 3 mismatches among 6 total words appeal to another student as a model
Farid 4 Text reading speed of the reading is fast but mispronounced two words repeats with raising intonation, asks to correct; reminds the rule of reading of –ph combination

After the lesson

1. Share your findings with the teacher. Talk about any students whose level appears to be different from that designed before.

2. Consider the data you have collected. Is there the linkage between students’ level and the level of difficulty of tasks?

3. Was the level of difficulty of learning activities appropriate to the level of students?

4. What were the overt language problems during the lesson?

Reflect

To what extent the task should be challenging for students?

How can you construct the instructions of the tasks in accordance with the level of competence of your students?

Is there any connection between seating arrangement, learners’ motivation, learning styles and learner levels?



List of references

 

1. Allen, J.P.B., Fröhlich, M. and Spada, N. (1984). The communicative orientation of language teaching. In Handscombe, J., Orem, R.A. and Taylor, B.P. (ed.). On TESOL ’83: the Question of Control. TESOL, Washington, DC.

2. Allport, G.M. (1942). The use of personal documents in psychological science. Quoted in F. McKernan (1996). Curriculum action research: a handbook of methods and resources for the reflective practitioner (p.84). London: Kogan Page.

3. Allwright, D. (1988). Observation in the language classroom. London: Longman.

4. Allwright, R.L. (1980). Turns, topics and tasks: patterns of participation in language teaching and learning. In D. Larsen-Freeman, editors., Discourse analysis in second language acquisition research (pp. 165-187). Rowley, Mass: Newbury House.

5. Allwright, D. and Bailey, K. (2000). Focus on the language classroom. Cambridge: Cambridge University Press.

6. Bailey, K. (1990). The use of diaries in teacher education programs. In J.C Richards,. and D. Nunan, editors,. Second language teacher education (pp.215-226). Cambridge: Cambridge University Press.

7. Bandura, A. (1977). Social Learning Theory. New York: General Learning Press

8. Bandura, A. (1993). Perceived self-efficacy in cognitive development and functioning. Educational Psychologists, 28, 117-148.

9. Bany, M. A. and Johnson, L. V. (1964). Classroom group behaviour: group dynamics in education. London: Macmillan, Collier-Macmillan.

10. Becker, H. S. (1971). Sociological work: methods and substance. London: Aldine.

11. Bellack, A.A. (1966). The language of the classroom. N.York: Teachers College.

12. Birkey, R. C. and Rodman, J.J. (1995). Adult Learning Styles and Preference for Technology Programs. Available: http://www2.nu.edu/nuri/llconf/conf1995/birkey.html

13. Bova, D. Heterogeneous Grouping: Is It Best for All Students? Available: http://www.middleweb.com/MWLISTCONT/MSLdifferentiation.html

14. Boyd, J.R. and Boyd, M.A. (1989). Input-output teacher's manual. Normal, IL: Abaca Books. Available: Adjunct ERIC Clearinghouse for ESL Literacy Education Washington DC. H:\teaching practice\ED383242 1995-05-00 Teaching Multilevel Adult ESL Classes_ ERIC Digest.htm

15. Bruton, A. (1997). Mixed capacities in EFL/ESL: clarifying the issue. RELC Journal, 28 (1), 109-119.

16. Buss, A., and Plomin, R. (1984). Temperament: Early personality traits. Hillsdale, N.J.: Erlbaum.

17. Campbell D. I. (1958). Information and control. Vol.1 Quoted in Fassnacht, G. (1982). Theory and practice of observing behaviour (p.40). London: Academic Press.

18. Canale, M. and Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied linguistics, 1, 1-47.

19. Capelle, G.C., Jarvilla,R.J. and Revelle, E. (n.d.). Development of computer-assisted observational systems for teacher-training. Quoted in Chaudron, C. (1988). Second language classrooms: research on teaching and learning (p.18). Cambridge: Cambridge University Press.

20. Chappel,C. A. (1995). Field-Dependence/Field-independence in the L2 classroom. In J. M. Reid, editor., Learning styles in the ESL/EFL classroom (pp.158-169). Boston: Heinle & Heinle Publishers.

21. Chaudron, C. (1988). Second language classrooms: research on teaching and learning. Cambridge: Cambridge University Press.

22. Cohen, L. and Mannion, L. (1994). Research methods in education. (4th edition). London: Routledge.

23. Croll, P. (1986). Systematic classroom observation. London: The Falmer Press.

24. Day, R. R. (1984). Student participation in the ESL classroom or some imperfections in practice. Language Learning, 34 (3), 69-107.

25. Day, R. R. (1990). Teacher observation in second language education. In J. C., Richards and D. Nunan, editors., Second language teacher education (pp. 43-61). Cambridge: Cambridge University Press.

26. Delamont, S. and Hamilton, D. (1976). Classroom research: a critique and a new approach. In M. Stubbsand and S. Delamont, editors., Explorations in classroom observation (pp. 3-21). London: John Wiley & Sons.

27. Delamont, S. and Hamilton, D. (1986). Revisiting classroom research: a continuing cautionary tale. In M. Hammerley, editor., Controversies in classroom research (pp.25-43). Milton Keynes: Open University Press.

28. Dossey, J. A, Mullis, I. V. S., Lindquist, M. M. and Chambers, D. L. (1988) The Mathematics Report Card: Are we measuring up? Trends and achievement based on the 1986 National Assessment. Princeton, ETS.

29. Dörney, Z. (1998). Motivation in second and foreign language learning. Language Teaching, 31, 117-135.

30. Eisner, E. (1993). Objectivity in educational research. In M. Hammersley, editor., Educational research: current issues (pp. 49-56). London: Paul Chapman in association with the Open University.

31. Elliot, J. and Ebbutt, D. (1986). Case studies in teaching for understanding. Cambridge: Cambridge Institute of Education.

32. Ericson, R., Bareaneck, P. and Chan, J. (1991). Representing order: crime, law and justice in the news media. Milton Keynes: Open University Press.

33. Fanselow, J. F. (1977). Beyond ‘Rachomon’ – conceptualizing and describing the teaching act. TESOL Quarterly, 11, 17-39.

34. Feather, N.T. (1982). Expectations and actions: expectancy-value models in psychology. Hillsdale, N.J.: Lawrence Erlbaum.

35. Fielding, N. (2001). Ethnography. In N. Gilbert, editor., Researching social life. (2nd ed.) (pp.145-163). London: SAGE Publications.

36. Flanders, N.A. (1970). Analyzing teaching behaviour. London: Addison-Wesley.

37. Gardner, R. C. (1985). Social psychology and second language learning: the role of attitudes and motivation. London: Edward Arnold.

38. Gayle, V. (2000). Quantitative data analysis. In D. Burton, editor., Research training for social scientists (pp.361-420). London: SAGE Publications.

39. Gellert, E. (1955). Systematic observation: a method in child study. Harvard Educational Review, 25, 179-195.

40. Good, T. and Brophy, J. (2000). Looking in classrooms (8th ed.). New York: Longman.

41. Goodman, N. (1976). The languages of art. Quoted in Eisner, E. (1993). Objectivity in educational research (p.52). In M. Hammersley, editor., Educational research: current issues (pp. 49-56). London: Paul Chapman in association with the Open University.

42. Gore, J. and Zeichner, K. (1991). Action Research and Reflective Teaching in Preservice Teacher Education: A Case Study from the United States. Teaching and Teacher Education, 7(2), 119-136.

43. Gregoire, A. F. (1979). Learning/teaching styles: potent forces behind them. Educational Leadership, 36, 234-236.

44. Hammersley, M. (1986). Revisiting Hamilton and Delamont: a cautionary note on the relationship[ between ‘systematic observation’ and ethnography. In M. Hammerley, editor., Controversies in classroom research (pp. 44-50). Milton Keynes: Open University Press.

45. Hargreaves D. H. (1980). Review of M. Ruttler et al. 15 00 hours. British Journal of Sociology of Education, 1(2), 211-216.

46. Holliday, A. (1994). Appropriate methodology and social context. Cambridge: Cambridge University Press.

47. Hollingworth, H.L. (1910). Journal of Philosophy, Psychology and Scientific Methodology, 7: 461-469. Quoted in G. Fassnacht (1982). Theory and practice of observing behaviour (p.40). London: Academic Press.

48. Hopkins, C.D. and Antes, R.L. (1985). Classroom measurement and evaluation. Itasca, Ill.: F.E. Peacock Publishers.

49. Hutt, S.J. and Hutt C. (1970). Direct observation and measurement of behaviour. Springfield: Charles C Thomas.

50. Jarvis, G. (1968). A behavioural observation system for classroom foreign-language skill acquisition activities. Modern Language Journal, 52, 335-341.

51. Jersild, A.T. and Meigs, M.F. (1939). Direct observation as a research method. Quoted in Hutt, S.J. and Hutt C. (1970). Direct observation and measurement of behaviour (p.3). Springfield: Charles C Thomas.

52. Johnson, D. W., and Johnson, R. T. (1989). Cooperation and Competition: Theory and Research. Edina, Minn.: Interaction Book Co.

53. Kagan, D.M. (1992). Professional growth among pre-service teachers and beginning teachers. Review of Educational Research, 62(2), 129-169.

54. Keefe, J. W. (1979). Learning styles: an overview. In J. W. Keefe, editor., Student learning styles: diagnosing and prescribing programs (pp. 1-17). Reston, Va.: National Association of Secondary School Principals.

55. Lee, A., Danis, C., Miller, T., & Jung, Y. (2001). Fostering social interaction in online spaces. In M. Hirose, editor., Human-Computer Interaction (INTERACT'01) – Eighth IFIP TC.13 Conference on Human-Computer Interaction (pp. 59-66): IOS Press.

56. Long, M. (1980). Inside the ‘black box’: methodological issues in classroom research on language learning. Language Learning, 30, 1-42.

57. Lofland, J. and Lofland, L. (1995). Analysing social settings: a guide to qualitative observation and analysis. Belmont, CA.: Wadsworth.

58. Lutz, F. W. (1986). Ethnography: the holistic approach to understanding schooling. In M. Hammerley, editor., Controversies in classroom research (pp.107-119). Milton Keynes: Open University Press.

59. Macdonald, K. (2001). Using documents. In N. Gilbert, editor., Researching social life (pp. 194-210). London: SAGE Publications.

60. Mandl, H. (1971) In W. Arnold, H. J. Eysenck, and R.Meili, editors., Lexicon der Psychologie. Vol.2. Quoted in G.Fassnacht (1982). Theory and practice of observing behaviour, p.41 London: Academic Press.

61. McIntyre, D. and Macleod, G. (1986). The characteristics and uses of systematic classroom observation. In M.Hammerley, editor., Controversies in classroom research (pp.10-23). Milton Keynes: Open University Press.

62. McKernan, J. (1996). Curriculum action research: a handbook of methods and resources for the reflective practitioner. London: Kogan Page.

63. Meara, P. (1996). The dimensions of lexical competence. In Brown, G., Malmkjær, J. Williams, editors., Performance and competence in second language acquisition (pp.33-53). Cambridge: Cambridge University Press.

64. Meece, J. and McColskey, W. (2001). Improving student motivation: a guide for teachers and school improvement teams. SERVE. ED-01-CO-0015. Available: http://www.serve.org/publications/rdism2.pdf

65. Millrood, R. (2002). Teaching heterogeneous classes. ELT Journal, 56 (2), 128-136.

66. Mishler, F.G. (1990). Validation in inquiry-guided research: the role of examples in narrative studies. Harvard Educational review, 60 (4), 415-441.

67. Mitchel, R., Parkinson, B. and Johnstone, R. (1981). The foreign language classroom; an observational study. Stirling Educational Monograph # 9, the Department of Education, University of Stirling.

68. Moskowitz, G. (1970). The foreign language teacher interacts. Quoted in C. Chaudron (1988). Second language classrooms: research on teaching and learning, p. 17. Cambridge: Cambridge University Press.

69. Muchnick, A.G., and Wolfe, D.E. (1982).Attitudes and motivation of American students of Spanish. The Canadian Modern Language Review, 38, 262-281.

70. Naiman, Neil, Frölich, M., Stern, H.H. and Todesco, A. (1978). The good language learner. Quoted in Chaudron, C. (1988). Second language classrooms: research on teaching and learning, p.18. Cambridge: CAMBRIDGE UNIVERSITY PRESS.

71. Oxford, R. and Ehrman, M. (1993). Second language research on individual differences. Annual Review of Applied Linguistics, 13, 188-205.

72. Phillips, D.C. (1993). Subjectivity and objectivity: an objectivity inquiry. In M. Hammersley, editor., Educational research: current issues (pp. 57-72). London: Paul Chapman in association with the Open University.

73. Pica, T., Holliday, L., Lewis, N., Berducci, D., and Newman, J. (1991). Second language learning through interaction: What role does gender play? Studies in Second Language Acquisition, 31, 343-76.

74. Politzer, R. L. (1980) Foreign language teaching and bilingual education: research implications. Foreign Language Annals, 13, 291-297.

75. Platt, J. (1981). Evidence and proof in documentary research. Sociological review, 29 (1), 31-66.

76. Radnor, H.A. (2002). Researching your professional practice: doing interpretive research. Buckingham, Philadelphia: Open University Press.

77. Ratcliffe, H. (1983). Notions of validity in qualitative research methodology. Knowledge: creation, diffusion, utilization, 5(2),147-167.

78. Richards, J. C. (1998). Beyond Training. Cambridge: Cambridge University Press.

79. Sattler, J.M. (1982). Assessment of children’s intelligence and abilities (2d ed.). Boston : Allyn and Bacon.

80. Scheurich, J. J. (1997). Qualitative studies series: 3. Research methods in the postmodern. London: the Falmer Press.

81. Scott, J. (1990). A matter of record: documentary sources in social research. Cambridge: Polity Press.

82. Seliger, H.W. (1977). Inductive and deductive method in language teaching: a re-examination. International Review of Applied Linguistics, 13, 1-18.

83. Seliger, H. W. and Shohamy E. (1989). Second language research methods. Oxford: Oxford University Press.

84. Shamim, F. (1996). In and out of the action zone: locution as a feature of instruction in large ESL classes in Pakistan. In K.M. Bailey and D. Nunan, editors., Voices from the language classroom (pp. 123-144). Cambridge: Cambridge University Press.

85. Simpson, M. and Tuson, J. (1995). Using observation in small-scale research: a beginner’s guide. Edinburgh: the Scottish Council for Research in Education.

86. Simon, A. and Boyer, G. E. (1974). Mirrors for behaviour 3. Philadelphia: Research for Better Schools. Quoted in S. Delamont and D. Hamilton (1986). Revisiting classroom research: a continuing cautionary tale (p.29). In M. Hammerley, editor., Controversies in classroom research (pp.25-43). Milton Keynes: Open University Press.

87. Singleton, D. (1989). Language acquisition: the age factor. Clevedon, Avon: Multilingual Matters

88. Smith, L.M. and Geoffrey, W. (1968). The complexities of an urban classroom. New-York: Holt, Rinehart and Winston.

89. Stroh, M. (2000). Qualitative interviewing. In D. Burton, editor., Research training social scientists (pp. 196-214). London: SAGE Publications.

90. Thornbury, S. (1991). Watching the whites of their eyes: the use of teaching-practice logs. ELT Journal 45 (2), 140-146.

91. Tudor, I., (1996). Learner-centredness as language education. Cambridge: Cambridge University Press.

92. Johson, M.C. (1977). A review of research methods in education. Chicago: Rand McNally College Publishing Company.

93. Veenman, S. (1984). Perceived problems of beginning teachers. Review of Educational research, 54(2), 143-178.

94. Wajnryb, R. (1992). Classroom observation tasks: resource book for language teachers and trainers. Cambridge: Cambridge University Press.

95. Walker, R. and Adelman, C. (1976). Strawberries. In M. Stubbs and S. Delamont, editors., Explorations in classroom observation (pp. 133-150). London: John Wiley & Sons.

96. Wallace, M. J. (1991). Training foreign language teachers: modes of teaching. Cambridge: CAMBRIDGE UNIVERSITY PRESS.

97. Wallace, M. J. (1998). Action research for language teachers. Cambridge: Cambridge University Press.

98. Weade, G. Locating learning in the times, spaces of teaching. In H.H. Marshall, edotir., Redefining student learning: roots of educational change (pp. 87-118). Norwood, NJ: Ablex.

99. Weick, K. E. (1968). Systematic observational methods. In G. Lindzey and E. Aronson, editors., (2d edition). The Handbook of social psychology, vol. 2 (pp. 357-451). Addison-Wesley.

100. Williams, M. and Burden, R. L. (1997). Psychology for language teachers: a social constructivist approach. Cambridge: Cambridge University Press.

101. Wright , H.F. (1960). Observational child study. In P.H. Mussen, editor., Handbook of research methods in child development, (pp. 71-139). New-York: Wiley.

102. Wrigley, H.S. and Guth, G. (1992). Bringing literacy to life: Issues and options in adult ESL literacy. San Mateo, CA: Aguirre International. (ED 348 896). Available: H:\teaching practice\ED383242 1995-05-00 Teaching Multilevel Adult ESL Classes_ ERIC Digest.htm

103. Violand-Sanchez, E. (1995). Cognitive and learning styles of high school students : implications for ESL curriculum development. In J. M. Reid, editor., Learning styles in the ESL/EFL classroom (pp.48-62). Boston: Heinle & Heinle Publishers.

104. Vygotsky, L.S. (1978). Mind in Society. Cambridge, MA: Harvard University Press.

Chapter 1

Introduction

 

Teaching Practicum in Kazakhstan

Teaching Practicum is compulsory for student teachers of graduate level enrolled in the English Language Teaching Department. Student teachers take Teaching Practicum at state schools, and follow the Teaching Practicum Curriculum issued by the Department of High Education of Kazakhstan. According to the foregoing Curriculum the Teaching Practicum consists of two periods: five-week period for the third-year students at the end of the 5th semester, December, and seven-week period for the fourth-year students at the beginning of the 7th semester, September and October.

Lesson observation is one of the major components of the Teaching Practicum. Both Teaching Practicums involve observation weeks: two weeks for the third-year students and one week for the fourth-year students. Observation weeks are devoted to observing lessons and familiarising with the school’s facilities, policies, procedures, pedagogical practices, and the preparation of timetable.

During the Observation Weeks student teachers have to observe lessons given by their monitor teachers to be aware of the methods and techniques of her/his teaching. In addition to it they observe the relationship between the teacher and students, students’ learning styles and their behaviour. To get better understanding of the learners’ personalities student teachers are recommended to observe lessons across other subject areas that are taught for the class they are allocated. At the same time pre-service teachers observe lessons of other experienced teachers who display exemplary teaching practices, and novice teachers to evaluate various teaching techniques at different levels of professional experience.

During the Observation Weeks student teachers are required to record their observations of fifteen English language classes for the third-year students and ten classes for the fourth-year students to be assessed. Students must have daily entries of their observations reflecting on various types of teaching or participation experience. Moreover, student teachers are strongly recommended to conduct peer observation and provide feedback on at least one lesson per day, and written feedback on at least two lessons per week during the Teaching Weeks.

 

Дата: 2019-07-24, просмотров: 187.