National Assessment Program – Literacy and Numeracy

The National Assessment Program – Literacy and Numeracy (NAPLAN) is a series of tests focused on basic skills that are administered annually to Australian students. These standardised tests assess students' reading, writing, language (spelling, grammar and punctuation) and numeracy and are administered by the Australian Curriculum, Assessment and Reporting Authority (ACARA). The National Assessment Program is overseen by the Council of Australian Governments Education Council.[1]

National Assessment Program – Literacy and Numeracy
Sign announcing tests, Greenbank State School, 2014
AcronymNAPLAN
TypeStandardised test
Developer / administratorAustralian Curriculum, Assessment and Reporting Authority
Knowledge / skills testedNumeracy, literacy
PurposeTo provide a snapshot of a student's current reading, writing, language and numeracy skills
Year started2008 (2008)
OfferedOnce a year
Countries / regionsAustralia
LanguagesEnglish
Scores / grades used bySchools (grades 3, 5, 7 and 9)
Websitewww.nap.edu.au/naplan/naplan.html

NAPLAN was introduced in 2008. ACARA has managed the tests from 2010 onwards.[2] The tests are designed to determine if Australian students are achieving outcomes.[2] There has been a great deal of contention in the educational community as to whether the tests are appropriate, whether teachers are teaching as they normally would or teaching to the test, and what the results of the test are being used for. The data obtained from the NAPLAN tests are collated and used to show all schools' average performance against other schools in the country on the Government My School website.[3]

The tests are also designed to be carried out on the same days all across Australia in any given year. Parents are able to decide whether their children take the test or not.[4] The vast majority of Year 3, 5, 7 and 9 students participate.

Background

Prior to the introduction of NAPLAN the testing of literacy and numeracy was done individually by each jurisdiction.[5] According to New South Wales Public Schools the NAPLAN tests, which commenced in 2008, were instigated after the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) determined that "national testing in literacy and numeracy would proceed for the full cohort of students in years 3, 5, 7 and 9 from 2008 onward".[6] The NAPLAN tests would be used to determine if students were performing either above, at or below the National Minimum Standard in the areas of reading, language conventions, writing and numeracy skills for their particular year level.[6] The emergence of a national schooling system in Australia is part of a shift towards making educational policy part of national economic policy in response to globalization.[7]

According to ACARA the main purpose of the NAPLAN tests is to measure whether literacy and numeracy skills and knowledge that provide the critical foundation for other learning and for their productive and rewarding participation in the community. In essence the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) influence brought about a series of tests to determine whether students being prepared for later life appropriately in the present day school system. The introduction of national literacy and numeracy tests in 2008 has provided consistency, comparability and transferability of information on students' literacy and numeracy performance

Stakeholders
External video
What is NAPLAN
Why NAPLAN is valuable

The primary stakeholders are students, parents and teachers. According to a Parent's Brochure the NAPLAN test results will be used to assist students and parents in discussing student progress with teachers, identifying students who require "greater challenges or additional support", identifying teaching program strengths and weaknesses and allow for school program review and support".[8]

Development

The development of the NAP tests began in 1999 when the Australian ministers of education worked together to produce the Adelaide declaration on national goals for schooling in the 21st century which sought to make all young Australian successful learners, confident and creative individuals and active and informed citizens.[9]

ACARA claims in their MySchool fact sheet that "processes have been put in place to ensure that NAPLAN is a valid and reliable measurement of students' literacy and numeracy ability".[10] It further goes on to state that "NAPLAN has a number of purposes including reporting national and jurisdictional achievements in literacy and numeracy as well as providing accurate and reliable measures of student and school performance. These purposes are carefully considered during the NAPLAN development process".

The development of the test includes input from indigenous experts from around the country to ensure the tests are designed to be inclusive of all students.[11] Intense community pressure on school performance has led to the growth of a test preparation industry.[12]

Each test contains between 30 and 40 questions.[13] Most students complete the tests by using a pencil and paper. In Victoria, Pearson Australia has been responsible for collecting NAPLAN data and marking some tests.[14] In Queensland the printing and distribution of tests, data collection and some marking is undertaken by Fuji Xerox Document Management Solutions which also processes tests from South Australia.[15]

In 2016, some schools trialled online testing.[16] In 2018 around 200,000 students sat online versions of the tests. It had been claimed that results from both styles of test would be able to be accurately compared, but doubts about that claim led to a delay in the release of preliminary results on the scheduled date of 8 August. Concern was expressed about delays in announcing results reducing their usefulness.[17]

Analysis and evaluation
"...at a national level we are seeing little change in student achievement in these important areas of learning."

Robert Randall, Chief Executive Officer, ACARA, [18]

The tests are not a high stakes event in a student's education. It is a snapshot of a student's current abilities. The tests do not measure higher-order thinking skills or creativity.[12] NAPLAN is a tool intended to be used for school improvement.[5]

Data from NAPLAN is modelled according to the item response theory.[13] This allows for comparisons to be made between tests, a process known as equating.

Validity and reliability

The down side of NAPLAN can be seen when teachers are teaching to the test rather than teaching to the curriculum as can be seen in Victoria where according to Perkins (2010) teachers have been told to "teach explicitly for the national tests that are the cornerstone of the Federal Government's controversial My School website".

NAPLAN is also valid in that "special provisions which typically will reflect the support normally provided in the classroom may be provided to students with disabilities or special needs".

The Validity and Reliability in Quality Assessment in relation to NAPLAN can be summed up by ACARA in that they use an equating process to "provide a high level of assurance as to the reliability of comparisons between years" and that this process ensures that "any test difference has been taken into account before making statements about one year's results compared to the next".[10]

Flexibility and fairness

On the point of fairness it is important not to just rate the fairness of the test itself but to also rate the procedure of giving the test as well. Apart from the fact that the test is given mid-year so not all learning may have been successfully completed as would be expected by the end of the year for that particular grade,[19] writes that Queensland Teachers Union president Steve Ryan said some schools "probably have devoted too much time to NAPLAN".[19]

Although the test itself is extremely fair in that all students perform the same test nationwide, it also does not seem to take into account the fact that students in schools don't just comprise the average but also include the likes of special needs students. ACARA points out that "Students can be exempted from one or more NAPLAN tests if they have significant intellectual or functional disability or if they are from a non-English-speaking background and arrived in Australia less than one year before the tests". It is understood therefore that NAPLAN is designed to test Literacy and Numeracy levels in students considered to be normal.[6] There is also the consideration to be given to the fact that selective schools can pick and choose which students attend their schools giving them unfair advantage in attaining higher scores in almost any national assessment and especially in NAPLAN.

Authenticity

As far as authenticity is concerned in the NAPLAN tests there are elements of real-world application and there are elements that are not real-world. One of the important points to consider however with the NAPLAN tests is that, especially in relation to numeracy, not all areas can have immediately foreseeable real-world application however that does not necessarily mean that the questions are unimportant. For the most part, the NAPLAN tests do seem to have quite a bit of real-world authenticity about them.

Results
YearBandNational
minimum standard
31 to 62
53 to 84
74 to 95
95 to 106
Source: National Minimum Standards[6]

The NAPLAN Data Service identify areas of strength or weakness within a school or classroom. At the classroom level, the Item Analysis Report, the Writing Criteria Report and (for numeracy in particular) the Assessment Area Report provide powerful diagnostic information which can be used to complement school assessment and to inform the planning of teaching and learning programs. Reports are usually delivered in September.[20] Each student tested receives a student report.[13] Schools receive detailed results as to how each student answered individual questions, but do not have access to what the questions were. The tests provide an indication, not a fine grading, of a student's performance.[13] Parents are only given general feedback as to which percentile band their children are in for each type of test. ACARA does not provide the magnitude of the measurement error or the imprecision of the tests.[13]

On average in almost all NAPLAN tests home-schooled students perform better than students who attend schools.[21] Some schools, particularly small ones, are reporting such significant changes in year to year results that the results are meaningless.[2]

The data from NAPLAN is collated onto the MySchool website. The Australian Primary Principals Association does not support the publication of results in a way that allows for easy intra-school comparisons.[22] The results are graded along a series of ten bands based on achieving complex solutions to questions and spanning all age groups.[20] Data analysis packages are available to schools.[12] Some school are using the results from NAPLAN on an individual basis when making decisions regarding enrolment.[19] Tests results are directly linked to federal funding agreements with the states.[23]

The delay between testing and the release of results has been criticised for taking too long to be useful within the same year.[16] The test results have shown that since 2008 Year 3 students have gained at reading, grammar and writing skills. They have also revealed that improvements in spelling and numeracy were achieved by Year 5 students while the writing skills of Year 7 and 9 students have declined.[18]

Availability of past tests

The 2012-2016 test are available.

The 2008-2011 tests are available, copies are also available from The Wayback Machine.

The tests appear to have become more difficult over time, particularly from 2008 to 2009.

gollark: Windows is stupid?
gollark: Ontoflubulated Internet Terminal.
gollark: Yes.
gollark: I don't think the extra one will help *much*.
gollark: Maybe by Christmas AMD will have new cards out.

See also

References
  1. "National Assessment Program". ACARA. Archived from the original on 3 March 2016. Retrieved 4 March 2016.
  2. Johnston, Jenny (2013). Contemporary Issues in Australian Literacy Teaching. lulu.com. p. 3132. ISBN 1300812826.
  3. Justine Ferrari (27 January 2010). "Parents' guide to My School website". The Australian. News Limited. Retrieved 25 February 2016.
  4. Brittany Vonow (22 February 2016). "School flouts NAPLAN; Principal 'doesn't believe in' the tests". The Courier-Mail. News Corp. Retrieved 23 February 2016.
  5. Guenther, John (2015). "Analysis of National Test Scores in very Remote Australian Schools". In Askell-Williams, Helen (ed.). Transforming the Future of Learning with Educational Research. IGI Global. pp. 125–127. ISBN 1466674962.
  6. "National Minimum Standards". NSW Education. Archived from the original on 8 April 2015. Retrieved 25 February 2016.
  7. Lingard, Bob; Wayne Martino; Goli Rezai-Rashti; Sam Sellar (2015). Globalizing Educational Accountabilities. Routledge. p. 8. ISBN 1134640803.
  8. "National Assessment Program Literacy and Numeracy 2010: Information for Parents" (PDF). ACARA. Archived (PDF) from the original on 4 March 2016. Retrieved 1 March 2016.
  9. "Why NAP?". ACARA. Archived from the original on 27 February 2016. Retrieved 4 March 2016.
  10. "My Schools Fact Sheet" (PDF). ACARA. January 2010. Archived (PDF) from the original on 4 March 2016. Retrieved 1 March 2016.
  11. Paulo, Santiago; Donaldson Graham; Herman Joan; Shewbridge Claire (2011). OECD Reviews of Evaluation and Assessment in Education OECD Reviews of Evaluation and Assessment in Education: Australia 2011 Volume 2011 of OECD Reviews of Evaluation and Assessment in Education. OECD Publishing. p. 60. ISBN 9264116672.
  12. Weatherby-Fell, Noelene (2015). Weatherby-Fell, Noelene (ed.). Learning to Teach in the Secondary School. Cambridge University Press. p. 97. ISBN 1107461804.
  13. Wu, Margaret (2015). "What National Testing Data Can Tell Us". In Lingard, Bob; Thompson, Greg; Sellar, Sam (eds.). National Testing in Schools: An Australian Assessment. Routledge. pp. 19–23, 27. ISBN 1317333683.
  14. Timna Jacks (23 December 2015). "Company marking NAPLAN accused of conflict of interest". The Age. Fairfax Media. Archived from the original on 25 January 2016. Retrieved 25 February 2016.
  15. "FXDMS wins $4.8m govt contract". ProPrint. Sulobu Media. 30 October 2014. Archived from the original on 4 March 2016. Retrieved 25 February 2016.
  16. Alexandra Smith (31 October 2014). "NAPLAN numeracy and literacy tests to be online in 2017". The Sydney Morning Herald. Fairfax Media. Archived from the original on 6 March 2016. Retrieved 25 February 2016.
  17. "Parents, kids left waiting on NAPLAN results as education bosses revolt". 8 August 2018. Retrieved 8 August 2018.
  18. Alexandra Smith (5 August 2015). "NAPLAN 2015: Education chiefs warn students are not improving". The Sydney Morning Herald. Fairfax Medi. Archived from the original on 10 April 2016. Retrieved 25 February 2016.
  19. Tanya Chilcott. "NAPLAN test focus slammed as students over-practise". The Courier-Mail. News Limited. Archived from the original on 12 June 2012. Retrieved 29 February 2016.
  20. Brady, Laurie; Kerry Kennedy (2013). Curriculum Construction. Pearson Higher Education AU. p. 200. ISBN 1486005152.
  21. Alexandra Smith (7 February 2016). "Home-schooled kids perform better in NAPLAN: report". The Sydney Morning Herald. Fairfax Media. Archived from the original on 11 February 2016. Retrieved 23 February 2016.
  22. "Strip results from My School website, say school principals". The Sydney Morning Herald. Fairfax Media. 1 February 2010. Archived from the original on 12 September 2014. Retrieved 11 September 2014.
  23. Miki Perkins (5 February 2010). "Teach for tests, teachers told". The Sydney Morning Herald. Faifax Media. Retrieved 1 March 2016.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.