---

---

URL of this page is http://www.skeptron.uu.se/broady/sec/erdc-0004.htm

International Workshop
Educational assessment in developing countries: the case of Mozambique

ILU, Uppsala University, April 26-28, 2000
Seminar rooms 1219 (Wednesday 26 through Friday 28)
and 3122 (Thursday 27, morning session)

 

Arranged by the Network for educational research in developing countries at ILU, Uppsala University
 <http://www.skeptron.uu.se/broady/sec/n-erdc.htm>

More information from:
Mikael Palme <mikael.palme@lhs.se>
Carol Benson <carol.benson@biling.su.se>
Donald Broady <broady@nada.kth.se>

---

Background

Educational assessment and pedagogical measuring potentially uphold important functions in education development in developing countries. Ideally, results from educational assessment would inform curriculum development and the design of teacher pre- and in-service training on pedagogical challenges that need to be addressed. They would also provide information to educational planners, politicians and the civil society on the performance of the education system generally, for example as regards gender inequalities and regional unbalance. For the individual teacher, an adequate evaluation of learning outcomes would be one of the means necessary for handling the discrepancy between curriculum demands and actual learning that often haunts primary teaching. Further, in education systems where few students reach higher levels, it is important that assessment instruments used for student selection are reasonably adequate.

In developed countries, educational assessment at a larger scale is a difficult and complex enterprise that often is subject to harsh criticism. For a number of reasons, large-scale educational assessment in developing countries is normally even more complex and risky. Often, little is known of the target population and to what extent it can be assumed to representative in specific respects. Since pupils are likely often to have different L1 and the local culture determining learning may be substantially different between regions, both the formulation of test items and the interpretation of test results may be particularly difficult. If test results are seen as indicators of complex learning processes that are determined by likewise complex cultural contexts of which often too little is known, the analysis of these results runs the constant risk of simplification and misinterpretation. Moreover, the organisational and economic conditions for schooling may differ between regions far more than what is normally the case in developed countries. An often poorly developed infra-structure in terms of transport and means of communication, in combination with an absence of traditions and skills for handling the administrative machinery required by large-scale assessment, also challenges attempts to develop national assessment programs.

At an international level, the IEA programme (International Association for the Evaluation of Educational Achievement) has since the 60’s carried through assessment tests in various countries for a comparative purpose.[1] As a continuation of the IEA studies, the TIMSS programme (The Third International Mathematics and Science Study) initiated in 1994-95 the carrying through of assessment tests at international level in mathematics and science.[2] As yet another extension of the IEA programme, the SACMEQ project (Southern African Consortium for Monitoring Educational Quality), linked to the Unesco institution IEPP, has in the 90’s monitored assessment test in various countries n Southern Africa.[3] The experiences from these internationally organised assessments of educational achievement have obviously been mixed. On the one hand, forms for transnational organisation of assessment programs have been developed and experiences have been gained on many of the difficulties related to the making and administration of tests in different national contexts and under varying conditions. On the other hand, tests have been criticised for not sufficiently reflecting the specific national, historic and cultural dimensions of the learning outcomes that have been measured and, hence, of being inadequate for the development of strategies for quality improvement in national contexts.[4]

In Mozambique, both the prior IEA and following-up SACMEQ tests have been administered. However, in 1997, the Ministry of Education initiated, through the national Institute for Education development (INDE), a properly national programme for educational assessment, funded by Finnish Finnida. In currently 3 provinces of the country, in a sample of schools, assessment tests in Portuguese, Mathematics and, more recently Science, have been administered and analysed by a group of researchers. In order to establish links with potential for giving a feedback to teacher education, test are worked out, administered and analysed in collaboration with Teacher Training Colleges. So far, the programme has produced two major reports on the first national assessment tests in the above mentioned subjects, including the proper tests, the presentation of test results and an analysis.

Most of the active members of the Network for educational research in developing countries at ILU, Uppsala University, have been actively engaged for many years in various kinds of research in Mozambique. This research includes an evaluation of teaching materials, assessment studies, studies of concept formation among pupils and teachers, as well as sociological analyses of schools, teachers and pupils in various parts of the country. This body of knowledge of Mozambican primary education represents an asset for the now ongoing national assessment project. It also represents a challenge, in the sense that it provides insights and an analysis of cultural and sociological aspects of teaching and learning, as well as of gender issues and region and social differences in the education system, that constitute an alternative basis for identifying and understanding the nature of problems related to the quality of primary education in the country. In other words, for the purpose of an in-depth analysis of problems related to educational assessment and pedagogical measuring in developing countries, a promising possibility exists to systematically and in detail relate this body of knowledge on Mozambican primary education to the design, carrying through and results of the on-going national assessment project. The arrangement of a workshop/conference with this objective has been made possible because of the willingness of the Finnida-funded assessment project in Mozambique to finance the participation both of the Mozambican experts working in the project and of the Finnish/Swedish consultants connected to it. The following application for funding regards the invitation of other African researchers and specialists in the area, as well as of Swedish researchers.

---

Aim

The workshop aims at discussing pertinent aspects of educational assessment and pedagogical measuring in developing countries, taking Mozambique as a case-study. The advantage of this approach is expected to be that penetrating into all the technical details of this projects, from sampling questions to the construction of specific items and the interpretation of results, and considering the theoretical dimensions of the questions dealt with, an in-depth approach to educational assessment and pedagogical measuring in a development context will be possible, as opposed to a discussion based on contributions from differing national contexts. However, through the participation by specialists with vast experience from other international assessment programmes (such as the SACMEQ programme or European programmes), the Mozambican project will contrasted to other similar assessment programmes. Further, the participation of researchers with various other research approaches to Mozambican primary education (linguistic, sociology and anthropology, didactics, conceptual studies, etc.) is expected to create the conditions for examining the role and contribution of educational assessment and testing to the understanding of the realities of primary education in the country.

---

Discussion themes

The workshop will address issues such as the following: 

1.      What different needs and demands does the assessment correspond to and what needs and demands could it realistically satisfy? Are these needs and demands potentially in conflict? What are the political uses of assessment? What trends and factors influence how assessment is shaped and how results are used? What would be the impact of the assessment administered by international organisations?

2.      What types of assessment tests are included and what are their differing objectives? To what extent can these objectives be combined and to what extent are they conflicting?

3.      The “operationalisation” of assessment: handling and administering the system from the national level to the local one; collecting the information on schools, teachers and the socio-cultural embedment of teaching; doing the tests and doing something with the them; working with reference groups; creating mechanisms for and feed-back from the teacher education system; the perception and role of assessment in the education system and in the local society.

4.      Over all dimensions of what is measured and should be taken into account in the selection and construction of test items: What should be measured and what can be measured? What are the gender-related dimensions of learning and skills and how can they be addressed and handled in assessment and measuring? What are the implications of the normally bi- or multilingual dimension of testing handled? How can skills and process-related abilities, as opposed to purely cognitive ones, be measured? What skills and abilities would that be? What are the implications for testing of the normally predominately oral culture to which the tested the target groups pertain? These aspects will be addressed in more detail in relation to the discussion of each one of the main subject areas.

5.      Sampling: relevant social, cultural and linguistic differences that potentially should be reflected; identification and use of indicators; classification of school-types; taking account of gender-related and regional differences.

6.      Assessment and measurement of primary mathematics: test items and test results analysis.

7.      Assessment and measurement of primary Portuguese learning: test items and test results analysis; the impact on bi- and multilingualism on language learning and language testing

8.      Science and skills testing: how can stages in cognitive development and skills be tested? What is the impact of the varying local regional cultures on children’s conceptual and skills’ development and how dependent is this development on the L1?

9.      Future staff development for the Mozambican group. International networking. Future collaboration with and links to Scandinavian educational research.

---

Agenda

 

Wednesday, April 26
9.00-9.15	Introduction, presentation of participants
9.15-10.00	The Mozambican National Assessment Programme Zeferino Martins, Abel Assis, Carlos Lauchande
10.00-10.30	A synthesis of results Jan-Erik Johansson
10.30-10.45	Coffee break
10.45-11.45	Political embedment; sampling; organisation of testing; procedures of data collection; reference groups; regional, social and gender differences Carlos Lauchande and Jan-Erik Johansson Discussant: Mikael Palme
11.45-12.30	Discussion
12.30-13.30	Lunch
13.30-15.45	Primary Portuguese testing. Maria João Carrilho and Marcelo Soverano  Discussants: Carol Benson and Mats Oscarsson
15.45-16.00	Coffee break
16.00-18.30	Continuation Primary Portuguese testing
19.00	Dinner
Thursday, April 27
9.00-9.45	Educational assessment in a historical and international perspective Ulf P. Lundgren
9.45-10.30	Experiences from the SACMEQ assessment tests in developing countries Ennie Molobe
10.30-10.45	coffee break
10.45-11.30	The Mozambican National Assessment Programme: background and main results Zeferino Martins, Abel Assis, Carlos Lauchande, Jan-Erik Johansson
11.30-13.00	Discussion and synthesis: alternative strategies in educational assessment; comparison with other assessment projects in both developed and developing countries Moderator: Staf Callewaert
13.00-14.30	Lunch
14.30-16.00	Primary Science and science skills testing  Presentation: Antuia Mogne, Tuula Asula and Matti Pylvanainen Discussant: Oleg Popov
16.00-16.15	Coffee break
16.15-17.30	continuation Primary Science and skills testing
19.00	Dinner
Friday, April 28
9.00-10.30	Primary Mathematics Testing Carlos Lauchande, Dinis Guibundana and Jorma Asunta Discussant: Wiggo Kilborn
10.30-10.45	Coffee
10.45-12.30	Contin. Primary Mathematics testing
12.30-14.00	Lunch
14.00-15.30	General discussion on the Mozambican educational assessment programme Moderator: Donald Broady
15.30-15.45	Coffee break
15.45-17.00	Future perspectives: capacity building for the Mozambican assessment programme, institutional links Moderator: Mouzinho Mário
17.00-17.30	Synthesis, conclusions, closing of the workshop

 

---

Participants

From Sweden:

Donald Broady, Prof of Education, ILU, Uppsala University	broady@nada.kth.se
Carol Benson, Centre for research on Bilingualism, Stockholm University	carol.benson@biling.su.se
Gustave Callewaert, Prof of Education, Copenhagen University	callew@swipnet.se
Holger Daun, lecturer, Dep. for Comparative Education, Stockholm University	holger.daun@int.ped.su.se
Kenneth Hyltenstam, Prof of Bilingualism, Centre for Research on Bilingualism, Stockholm University	kenneth.hyltenstam@biling.su.se
Gunilla Höjlund, Stockholm Institute of Education	gunilla.hojlund@lhs.se
Jan-Erik Johansson, Prof of Education, Oslo University	Jan-Erik.Johansson@lu.hioslo.no
Wiggo Kilborn, lecturer, Gothenburg University	wiggo.kilborn@ped.gu.se
Valdy Lindhe, lecturer, ILU, Uppsala University	valdy.lindhe@ilu.uu.se
Ulf P. Lundgren, Prof of Education, Uppsala University	Ulf.P.Lundgren@skolverket.se
Bent-Olov Molander, Stockholm Institute of Education	Bengt-Olov.Molander@lhs.se
Mikael Palme, Stockholm Institute of Education and ILU, Uppsala University	mikael.palme@lhs.se
Mats Oscarsson, lecturer, Gothenburg University	mats.oscarsson@ped.gu.se
Oleg Popov, lecturer, Umeå University	oleg.popov@educ.umu.se
Hans Persson, Sida	hans.persson@sida.se

From other Scandiniavian countries:

Ellen Carm, Hogskolen i Oslo	Elle.carm@lu.hioslo.no
Matti Pyivalainen, University of Jyväskylä	matti.pylvanainen@jyu.fi
Tuula Asunta, University of Jyväskylä	tasunta@edu.jyu.fi
Jorma Asunta, University of Jyväskylä	jasunta@jypoly.fi
Jette Steensen, University of Copenhagen	Jette_Steensen@nns.dk
Tuomas Takala, University of Tampere	katuta@uta.fi

From African countries:

Carlos Lauchande, Universidade Pedagógica and INDE, Mozambique	Carlos.Lauchande@mined.uem.mz
Abel Assis, Ministry of Education, Mozambique
Maria João Carrilho, INDE, Mozambique
Antuia Mogne, INDE, Mozambique	antuia@inde.uem.mz
Marcelo Soverano, INDE, Mozambique
Mouzinho Mário, University Eduardo Mondlane, Mozambique	mouzinho@zebra.uem.mz
Ennie Molobe, Ministry of Education, Botswana, SACMEQ	emolobe@gov.bw
Zeferino Martins, Ministry of Education, Mozambique	Zeferino.Martins@mined.uem.mz
Mubanga Kashoki, University of Zambia	Presently: mubanga.kashoki@biling.su.se
Calisto Ribeiro, UP, Mozambique	r_calisto@hotmail.com

---

URL of this page is http://www.skeptron.uu.se/broady/sec/erdc-0004.htm
Last updated 26 April 2000
Back to SEC home page