EDUCATION MATTERS

30 lakh primary-schoolers to be tested in India’s largest ever learning assessment exercise

The National Achievement Survey in September-October will be different from previous rounds both in size and design.

The National Council for Educational Research and Training is getting ready to conduct its largest ever learning assessment test for primary school children in September-October. With a sample size of over 30 lakh students drawn from Classes 3, 5 and 8 from schools across the country, it will dwarf all other large-scale assessments in India, public or private, and even some international ones.

The council, which advises the Central and state governments on school education matters, has been conducting a National Achievement Survey once every three years since 2001. But the upcoming exercise – born of the general alarm about the declining quality of education in the country – is vastly different. “We are still calling it the National Achievement Survey,” said Y Sreekanth, who heads the council’s educational survey division. But unlike the old version that tested children of one class in each round, the new one will test three classes at once. Its organisation will be decentralised – this was imperative, given the scale of the operation – and it will also be linked to Aadhaar, the 12-digit biometrics-based unique identity number. Most importantly, the results will be out within a year unlike the three years it previously took. Authorities hope this, along with the involvement of teacher-training centres in the exercise, will make early intervention possible.

Anil Swarup, school education secretary in the Human Resource Development Ministry, said the “on-field assessment” will be conducted in September and October and “the feedback assessment” will be completed by December-end. “Changes will be introduced in the last quarter of the academic year based on the assessment and feedback,” he was quoted as saying by PTI.

Added Sreekanth, “The effort is to complete the process in one year and provide feedback within the same academic session.”

In numbers

The original National Achievement Survey tested 1.5 lakh to 2.5 lakh children in each round. “We derived samples with the state as the unit and held tests in all 36 states and Union territories,” explained Sreekanth. “But from now, the district will be the unit and the data much more granular. The objective is to find out how [students] are performing and provide intervention.”

The 30-lakh sample size will include 4,500 primary-schoolers from each of India’s 700-odd districts.

To put that into perspective, the Annual Status of Education Report, of the non-governmental organisation Pratham, tested over 5.6 lakh children between the ages of three and 16 for its last survey. And in 2015, the international Programme for International Students Assessments tested 5 lakh 15-year-olds across 72 countries.

Learning outcomes

Like in previous National Achievement Surveys, students of Classes 3 and 5 will be tested on mathematics, environmental science and language, and those of Class 8 on science, social science, mathematics and language. But the National Council for Educational Research and Training has tweaked the design a bit. “We will see in each class [how] students have performed against the new learning outcomes,” said Sreekanth, referring to a document released by the council in January that spells out what skills students of a particular class are expected to master.

“There are items of different kinds in the test – some of a basic level, some intermediate and some advanced,” he added. “We give all three to see how children are performing and this can be very useful for teacher-training both pre-service and in-service [training for a teaching qualification and training while employed]. Also, we have seen that children do better in subjects like mathematics if they can relate to the items and have visual cues.”

The test data will then be analysed against three parameters – location (rural or urban), gender, and social categories – and reports on the same will be released to the public.

In addition, there will be questionnaires to gather information from and about teachers as well as about school facilities and households.

Students will be tested on mathematics, language, science, environmental science and social science. (Credit: Nanhi Kali)
Students will be tested on mathematics, language, science, environmental science and social science. (Credit: Nanhi Kali)

Quick results

The results of previous surveys took three years to come. But with radical logistical changes and the involvement of various institutions, Sreekanth expects the new exercise to speed up the results process, even with the massive increase in the sample size.

In a first, the National Council for Educational Research and Training has roped in Block Resource Centres, set up by the government to conduct in-service training of teachers, and District Institutes of Education and Training, which train teachers pre-service, for this exercise.

The tests will continue to be multiple-choice and written on regular answer scripts but those will no longer be shipped back to the council for processing. “Teachers will mark out the answers on OMR [optical mark reading] sheets [used for computerised paper-checking],” said Sreekanth. Next, the sheets will be scanned at the district level and loaded on to a purpose-built software so that they can be shared with the council. “But an autogenerated report will be available for the schools quickly, almost as soon as the data is uploaded,” he said. And help will be at hand from the teacher-training centres for schools that need course correction mid-session.

This process was pilot-tested in March with 15 schools in each of 17 states, including Karnataka, Manipur and Himachal Pradesh.

The test is also being linked – in another first – with the District Information System for Education, a database of information about schools that is maintained by the National Institute of Educational Planning and Administration, and through that to Aadhaar. “This will allow us to monitor students’ performances over time and we do not have to collect background information every time we test them,” said Sreekanth. “The district information system will handle data collection on social categories, facilities available in schools and teachers.”

Fewer tests?

When the government released the draft for the new learning outcomes in January and announced its intention to include these in the Central Rules of the Right to Education Act, educationists feared this would lead to a “testing regime”.

But Sreekanth pointed out that the expansion of the National Achievement Survey would eventually render the State Level Assessment Surveys obsolete. In his opinion, they are of little help anyway. “The data generated was not properly utilised, we were only getting numbers – how many are meeting the benchmark,” he said. “What we need instead is descriptive, qualitative feedback. We need to know where exactly a student is poor and supplement the efforts of the schools.”

He added that the National Council for Educational Research and Training, in general, discourages repeated testing. “Some schools were conducting the SLAS [State Level Assessment Surveys] multiple times and others were conducting the Summative Assessment 2 [second term exams] through standardised tests,” he said.

In addition to the new National Achievement Survey, the council has designed assessment tests for all primary classes (1 to 8) that schools can administer on their own.

We welcome your comments at letters@scroll.in.
Sponsored Content BY 

What hospitals can do to drive entrepreneurship and enhance patient experience

Hospitals can perform better by partnering with entrepreneurs and encouraging a culture of intrapreneurship focused on customer centricity.

At the Emory University Hospital in Atlanta, visitors don’t have to worry about navigating their way across the complex hospital premises. All they need to do is download wayfinding tools from the installed digital signage onto their smartphone and get step by step directions. Other hospitals have digital signage in surgical waiting rooms that share surgery updates with the anxious families waiting outside, or offer general information to visitors in waiting rooms. Many others use digital registration tools to reduce check-in time or have Smart TVs in patient rooms that serve educational and anxiety alleviating content.

Most of these tech enabled solutions have emerged as hospitals look for better ways to enhance patient experience – one of the top criteria in evaluating hospital performance. Patient experience accounts for 25% of a hospital’s Value-Based Purchasing (VBP) score as per the US government’s Centres for Medicare and Mediaid Services (CMS) programme. As a Mckinsey report says, hospitals need to break down a patient’s journey into various aspects, clinical and non-clinical, and seek ways of improving every touch point in the journey. As hospitals also need to focus on delivering quality healthcare, they are increasingly collaborating with entrepreneurs who offer such patient centric solutions or encouraging innovative intrapreneurship within the organization.

At the Hospital Leadership Summit hosted by Abbott, some of the speakers from diverse industry backgrounds brought up the role of entrepreneurship in order to deliver on patient experience.

Getting the best from collaborations

Speakers such as Dr Naresh Trehan, Chairman and Managing Director - Medanta Hospitals, and Meena Ganesh, CEO and MD - Portea Medical, who spoke at the panel discussion on “Are we fit for the world of new consumers?”, highlighted the importance of collaborating with entrepreneurs to fill the gaps in the patient experience eco system. As Dr Trehan says, “As healthcare service providers we are too steeped in our own work. So even though we may realize there are gaps in customer experience delivery, we don’t want to get distracted from our core job, which is healthcare delivery. We would rather leave the job of filling those gaps to an outsider who can do it well.”

Meena Ganesh shares a similar view when she says that entrepreneurs offer an outsider’s fresh perspective on the existing gaps in healthcare. They are therefore better equipped to offer disruptive technology solutions that put the customer right at the center. Her own venture, Portea Medical, was born out of a need in the hitherto unaddressed area of patient experience – quality home care.

There are enough examples of hospitals that have gained significantly by partnering with or investing in such ventures. For example, the Children’s Medical Centre in Dallas actively invests in tech startups to offer better care to its patients. One such startup produces sensors smaller than a grain of sand, that can be embedded in pills to alert caregivers if a medication has been taken or not. Another app delivers care givers at customers’ door step for check-ups. Providence St Joseph’s Health, that has medical centres across the U.S., has invested in a range of startups that address different patient needs – from patient feedback and wearable monitoring devices to remote video interpretation and surgical blood loss monitoring. UNC Hospital in North Carolina uses a change management platform developed by a startup in order to improve patient experience at its Emergency and Dermatology departments. The platform essentially comes with a friendly and non-intrusive way to gather patient feedback.

When intrapreneurship can lead to patient centric innovation

Hospitals can also encourage a culture of intrapreneurship within the organization. According to Meena Ganesh, this would mean building a ‘listening organization’ because as she says, listening and being open to new ideas leads to innovation. Santosh Desai, MD& CEO - Future Brands Ltd, who was also part of the panel discussion, feels that most innovations are a result of looking at “large cultural shifts, outside the frame of narrow business”. So hospitals will need to encourage enterprising professionals in the organization to observe behavior trends as part of the ideation process. Also, as Dr Ram Narain, Executive Director, Kokilaben Dhirubhai Ambani Hospital, points out, they will need to tell the employees who have the potential to drive innovative initiatives, “Do not fail, but if you fail, we still back you.” Innovative companies such as Google actively follow this practice, allowing employees to pick projects they are passionate about and work on them to deliver fresh solutions.

Realizing the need to encourage new ideas among employees to enhance patient experience, many healthcare enterprises are instituting innovative strategies. Henry Ford System, for example, began a system of rewarding great employee ideas. One internal contest was around clinical applications for wearable technology. The incentive was particularly attractive – a cash prize of $ 10,000 to the winners. Not surprisingly, the employees came up with some very innovative ideas that included: a system to record mobility of acute care patients through wearable trackers, health reminder system for elderly patients and mobile game interface with activity trackers to encourage children towards exercising. The employees admitted later that the exercise was so interesting that they would have participated in it even without a cash prize incentive.

Another example is Penn Medicine in Philadelphia which launched an ‘innovation tournament’ across the organization as part of its efforts to improve patient care. Participants worked with professors from Wharton Business School to prepare for the ideas challenge. More than 1,750 ideas were submitted by 1,400 participants, out of which 10 were selected. The focus was on getting ideas around the front end and some of the submitted ideas included:

  • Check-out management: Exclusive waiting rooms with TV, Internet and other facilities for patients waiting to be discharged so as to reduce space congestion and make their waiting time more comfortable.
  • Space for emotional privacy: An exclusive and friendly space for individuals and families to mourn the loss of dear ones in private.
  • Online patient organizer: A web based app that helps first time patients prepare better for their appointment by providing check lists for documents, medicines, etc to be carried and giving information regarding the hospital navigation, the consulting doctor etc.
  • Help for non-English speakers: Iconography cards to help non-English speaking patients express themselves and seek help in case of emergencies or other situations.

As Arlen Meyers, MD, President and CEO of the Society of Physician Entrepreneurs, says in a report, although many good ideas come from the front line, physicians must also be encouraged to think innovatively about patient experience. An academic study also builds a strong case to encourage intrapreneurship among nurses. Given they comprise a large part of the front-line staff for healthcare delivery, nurses should also be given the freedom to create and design innovative systems for improving patient experience.

According to a Harvard Business Review article quoted in a university study, employees who have the potential to be intrapreneurs, show some marked characteristics. These include a sense of ownership, perseverance, emotional intelligence and the ability to look at the big picture along with the desire, and ideas, to improve it. But trust and support of the management is essential to bringing out and taking the ideas forward.

Creating an environment conducive to innovation is the first step to bringing about innovation-driven outcomes. These were just some of the insights on healthcare management gleaned from the Hospital Leadership Summit hosted by Abbott. In over 150 countries, Abbott, which is among the top 100 global innovator companies, is working with hospitals and healthcare professionals to improve the quality of health services.

To read more content on best practices for hospital leaders, visit Abbott’s Bringing Health to Life portal here.

This article was produced on behalf of Abbott by the Scroll.in marketing team and not by the Scroll.in editorial staff.