BBC News: 'Online tests to replace paper exams within a decade'

[sonofsanta]

BBC News - 'Online tests to replace paper exams within a decade'

 

Failing, as ever, to take into account the fact that it is impossible to have 350 students sitting at a computer under supervision all at the same time, as we'd need when the whole Year 11 and Year 13 cohort have an exam at the same time (as is due to happen this coming summer, I believe - RE and General Studies, or something like that). To do that here we'd be kicking people out of offices to use their computer, and probably need around 150 invigilators as a result.

 

Pie in the sky, much?

[localzuk]

That's clever of them. Just thinking of the hassle of setting up the requirements for 60 GCSE photography students was bad enough.

 

Suites aren't really any good - as the spacing doesn't match the rules in my experience.

[AMLinington]

Perhaps we need to change the environment entirely - maybe ALL classrooms should be IT suites. I'd LOVE to see the budget on that one though! LOL

[CESIL]

Give me the money to have a 1:1 ratio of pupils to computers and I will happily set them up...but...

 

...we will needs loads of extra wall sockets to power them, and the money to pay for that power, and more classroom space to house them...

 

...unless we supply tablets for all...again...give me the money and we will do it

[X-13]

Perhaps we need to change the environment entirely - maybe ALL classrooms should be IT suites. I'd LOVE to see the budget on that one though! LOL

 

Nah, they're just assuming we've all got 1-to-1 iPads.

 

Setup the hall for the exam, use the force iPad exam app instead of a paper exam.

[localzuk]

Nah, they're just assuming we've all got 1-to-1 iPads.

 

Setup the hall for the exam, use the force iPad exam app instead of a paper exam.

 

I'd love to see the kids all do essay questions on ipads.

[X-13]

I'd love to see the kids all do essay questions on ipads.

 

Instant A+ if the iPad is still intact at the end of the exam [and you've written something substantial. ]

[AMLinington]

I don't think tablet devices are feasible because the keyboards and typing options are not suitable for essay writing. Thin clients on the other hand...

[Ephelyon]

Then they'll make it cloud-based and all use Chromebooks...

[sted]

whatever it is they will all need mains power just in case so just think of having to give a room 100+ power sockets and possibly the same network sockets to be used for a few weeks a year And someone will have to test each of them before every exam

[X-13]

Then they'll make it cloud-based and all use Chromebooks...

 

Garunteed if that happened, there'd be at least one school lacking the infrastructure for it.

 

And they wouldn't realise until halfway through the first exam.

[happymeal]

You wouldn't need that - and it's perfectly do-able.

 

I work for a certain exam provider that has several testing centers across the UK, and we run several theory tests as well as IT tests, medical tests, etc.

 

Our test centers run anywhere between 5-30 machines, with CCTV in the exam rooms, and 3 invigilators. The PC's are locked down during the test and it makes it near impossible to exit the test without an invigilator there.

 

The other test centers run in a similar fashion - depending on the test they'll have either CCTV or just invigilators walking the floor.

 

It could easily run off a workgroup or a server scenario - depending on the environment.

[sonofsanta]

You wouldn't need that - and it's perfectly do-able.

 

I work for a certain exam provider that has several testing centers across the UK, and we run several theory tests as well as IT tests, medical tests, etc.

 

Our test centers run anywhere between 5-30 machines, with CCTV in the exam rooms, and 3 invigilators. The PC's are locked down during the test and it makes it near impossible to exit the test without an invigilator there.

 

The other test centers run in a similar fashion - depending on the test they'll have either CCTV or just invigilators walking the floor.

 

It could easily run off a workgroup or a server scenario - depending on the environment.

 

Oh it can be done - I did exams on a computer for my A-Level, for certain Maths modules - but saying that all exams will be computer based, when some of those exams are taken by 180 kids (or more) at the same time, is an unworkable scenario. Even more so when another year group is taking a compulsory exam at the same time. Either you turf everyone out of every computer room in school, or you build an infrastructure that sits largely unused for 49 weeks of the year just to run exams for three weeks on computers, thereby solving a problem that didn't exist when you just did it on paper at a desk.

 

Reminds me a bit of controlled assessments. No access to work out of scheduled lessons, no access to pre-prepared materials, and no internet access? Bit of a faff on a computer. What's the easiest way? A4 and a biro

[LosOjos]

Our test centers run anywhere between 5-30 machines

 

We average 250 students in Y11, assuming they go by the same rules as current they'd all have to sit at the same time (so they can't walk out of the exam and tell their mates the answers).

 

What happens if the network (internal or external) goes down? It has been known to happen... entire country has to resit the exam?

[plexer]

You wouldn't need that - and it's perfectly do-able.

 

I work for a certain exam provider that has several testing centers across the UK, and we run several theory tests as well as IT tests, medical tests, etc.

 

Our test centers run anywhere between 5-30 machines, with CCTV in the exam rooms, and 3 invigilators. The PC's are locked down during the test and it makes it near impossible to exit the test without an invigilator there.

 

The other test centers run in a similar fashion - depending on the test they'll have either CCTV or just invigilators walking the floor.

 

It could easily run off a workgroup or a server scenario - depending on the environment.

 

Yes 30 machines not 300 or even 100.

 

Ben

[sted]

We average 250 students in Y11, assuming they go by the same rules as current they'd all have to sit at the same time (so they can't walk out of the exam and tell their mates the answers).

 

What happens if the network (internal or external) goes down? It has been known to happen... entire country has to resit the exam?

 

or if its online some body decides to hack in and change/delete all the papers?

[localzuk]

You wouldn't need that - and it's perfectly do-able.

 

I work for a certain exam provider that has several testing centers across the UK, and we run several theory tests as well as IT tests, medical tests, etc.

 

Our test centers run anywhere between 5-30 machines, with CCTV in the exam rooms, and 3 invigilators. The PC's are locked down during the test and it makes it near impossible to exit the test without an invigilator there.

 

The other test centers run in a similar fashion - depending on the test they'll have either CCTV or just invigilators walking the floor.

 

It could easily run off a workgroup or a server scenario - depending on the environment.

 

Testing 30 people is not the same as testing 200 at the same time. Why the same time? Because you don't want the first batch telling the others the questions when they get out of the exam. They have to be the same questions too, else it isn't a fair test.

 

So, you have to run them simultaneously.

 

Not many schools can run 200 computers, invigilated and in exam conditions/layout.

[AMLinington]

Testing 30 people is not the same as testing 200 at the same time. Why the same time? Because you don't want the first batch telling the others the questions when they get out of the exam. They have to be the same questions too, else it isn't a fair test.

 

So, you have to run them simultaneously.

 

Not many schools can run 200 computers, invigilated and in exam conditions/layout.

 

So the only way it would happen is to have invigilators in each classroom and the year group would be split between the invigilated classrooms.

[happymeal]

Largest I've seen was 150 candidates for SAS (no, not THEM), where candidates came in, were seated down, and the tests launched from the Admin's PC. Once the candidate finished, they were moved out of the test area, and once the exams started at that time had finished, they brought in the next load. You may need to use a few rooms, but then again, you're doing that anyway for written tests.

 

Look at the Driving Agency tests as an example. 45 mins per test - each session is staggered so that the candidates are seated within 5-10 mins, tests are started and then end, and 5 mins to clear them out. Next session can then begin.

 

The exams are usually encrypted and downloaded to either the Admin desk or the server, and the kit we use downloads at least 3 days worth in advance (In case of a site losing Internet connectivity for a few days). If the local network goes down then yes - it's a problem. The exams are usually saved as they answer each question - it would be a case (and this is a rare occasion, where you've checked everything works, started the test, and it's gone down) of stopping, getting network connectivity back up, and resuming the test.

 

And I'm guessing there's a level of security on the machines (ie turning off RDP services, telnet, and messenging?) to prevent sneaky attempts at proxy testing/passing info.

[sonofsanta]

Largest I've seen was 150 candidates for SAS (no, not THEM), where candidates came in, were seated down, and the tests launched from the Admin's PC. Once the candidate finished, they were moved out of the test area, and once the exams started at that time had finished, they brought in the next load. You may need to use a few rooms, but then again, you're doing that anyway for written tests.

 

Look at the Driving Agency tests as an example. 45 mins per test - each session is staggered so that the candidates are seated within 5-10 mins, tests are started and then end, and 5 mins to clear them out. Next session can then begin.

 

The exams are usually encrypted and downloaded to either the Admin desk or the server, and the kit we use downloads at least 3 days worth in advance (In case of a site losing Internet connectivity for a few days). If the local network goes down then yes - it's a problem. The exams are usually saved as they answer each question - it would be a case (and this is a rare occasion, where you've checked everything works, started the test, and it's gone down) of stopping, getting network connectivity back up, and resuming the test.

 

And I'm guessing there's a level of security on the machines (ie turning off RDP services, telnet, and messenging?) to prevent sneaky attempts at proxy testing/passing info.

 

So continuing my worst case example, 360 kids - we have 4 IT rooms of 30 computers, so we'd need to do three shifts. Exams can be as long as 2½ hours (English GCSE), so that's a total of 7½ hours of kids having to be monitored constantly - during which time, in all likelihood, afternoon exams would be scheduled to start, that would have to be delayed, and could end up with invigilators pulling 12 hour+ shifts dealing with hordes of bored & frustrated teenagers.

 

No-one's saying it can't be done. We've all done it - AS/A2 listening exams are done in computer rooms here so students can listen through headphones, for one example. But the original article was a head saying all exams would be done on computers, and some exams are for an enormous cohort, much bigger than the 20-25 we get in a French AS group. The scale makes it untenable.

 

And regarding using a few rooms for current exams - no we're not. Written exams are all done in one room, the gym. Different exams going on alongside each other.

[happymeal]

I won't lie - it'll be a challenge, more for some schools than others. For special testing events (twice a year type jobs) we've been known to come in at 7:30am and kick off the testing until 8:00pm. I'm not saying that's what's going/should happen with schools - it's just nor workable or fair on the students.

 

One scenario would be to maybe go to a center setup just for this type of testing?

Or a set of laptops are delivered to schools for testing - would be a case of just having a laptop on the desk instead of paper - and once done, secured away until the next testing day.

Or (for a giggle) OFSTED have a team who will come into schools to setup testing equipment for the exams (Currently happens for RCP events across the UK)?

 

It's definitely a challenge which would require schools to effectively have a desktop/laptop readied for each student in year 11 to take a test.

[AMLinington]

So continuing my worst case example, 360 kids - we have 4 IT rooms of 30 computers, so we'd need to do three shifts. Exams can be as long as 2½ hours (English GCSE), so that's a total of 7½ hours of kids having to be monitored constantly - during which time, in all likelihood, afternoon exams would be scheduled to start, that would have to be delayed, and could end up with invigilators pulling 12 hour+ shifts dealing with hordes of bored & frustrated teenagers.

 

No-one's saying it can't be done. We've all done it - AS/A2 listening exams are done in computer rooms here so students can listen through headphones, for one example. But the original article was a head saying all exams would be done on computers, and some exams are for an enormous cohort, much bigger than the 20-25 we get in a French AS group. The scale makes it untenable.

 

Exactly, unless in the next decade all classrooms will be outfitted with PCs or Thin clients in which case you would have the whole cohort split into X number of classrooms. It is untenable given the current infrastructure but if you consider the 'School of the future' and imagine how things COULD change, it COULD become feasible. Although considering that many schools are still using Windows XP due to budget constraints I won't hold my breath that the money will be there for upgrades like this.

[Ephelyon]

They have to be the same questions too, else it isn't a fair test.

 

Not necessarily. You can have e.g. A, B, C and D papers for the same exam, each balanced appropriately to equalise the difficulty and with separate marking/moderation teams for each (or they all "revise" the lot). After all, barring Government fiddling, the English GCSE from 2010 should be roughly the same in difficulty as the exam from 2011 because the level of qualification is the same, so surely it's perfectly possible to have different questions that each test a candidate's ability in the same way and to the same degree. They would just issue those four separate versions of the exam, turning a cohort of 200 into 50 per session, so that's only two labs' worth at a time, perfectly feasible (here at least) and it doesn't matter if they talk to each other in between because the questions are different.

[LosOjos]

But that means more work for the exam boards, who will pass that cost to the school, who are already down for thousands on a new IT infrastructure that they didn't have the budget for in the first place...

[Ephelyon]

If you do it as above though, you don't need a massive new infrastructure as you can then fit it into your existing labs without too much disruption (and let's face it, there's always some disruption around exams time so that's nothing new). Also, I'm not sure just how much extra work there would be for the exam boards as essentially it's just an extension of existing practices. Add to that the exam boards' savings (both in money and effort) in printing and delivering all those papers - plus the schools' savings in buying and storing them - and I'd imagine it would at least balance out. Edited September 20, 2013 by Ephelyon