Category: Assessment

Posted on

My Grandmother's Country

Just wanted to share this Voicethread that some of my students did (there are still more kids to add their voices yet). In my Year 7 art class we were looking at the work of contemporary Australian aboriginal artist Sally Morgan, and the students had to examine a painting called My Grandmother’s Country. We had quite a long discussion about it in class and looked at some of the symbolism used in the painting. The students then had to write a response to the work.

In the past, this task is usually done purely as a text-only task… it gets discussed in class and they then do the writing at home. I thought I’d try using Voicethread instead, because it allowed them to access the artwork from home, to zoom in to see detail, and to hear me re-explain what they needed to do with it. (I know, I know, YOUR students never forget anything you tell them in class, but mine sometimes do).

They were a bit shy about leaving voice comments at first, so instead they wrote a written response as usual, but many said it was really useful being able to hear the task explained again from home. After they submitted the written task, which I thought they mostly did pretty well, I got them to record some of their responses as audio files which we uploaded to Voicethread along with their photo. This ability to upload audio to Voicethread instead of having to record it directly onto the page is a feature of a Voicethread Pro account, which is available to educators at no cost. I found it made it so much easier to collect the audio comments, especially since this class is not in a room with computers. I use my MacBook Pro to record their audio to QuickTime, convert it to MP3 using QuickTime Pro, snap a photo using Photobooth and then I do the uploading after class or whenever it’s convenient.

Anyway, for what it’s worth, here are some of their observations so far… if you want to leave an encouraging (moderated) comment for them that would be wonderful…

[kml_flashembed movie="http://voicethread.com/book.swf?b=15007" width="600" height="450" wmode="transparent" /]

It will be interesting to see if the quality of their speaking and recording changes once they realise that they have an audience…

PS: Thanks to @nzchrissy via @alannahk for pointing me to the solution to embedding these Voicethreads into the blog like this. Nice!

Posted on

A Testing Experience

I’m sitting in class at the moment with a group of Year 10 students as they do the NSW Board of Studies exam for computing skills. For those that don’t know, the Year 10 Computer Skills Test, or CST10, is a NSW government initiative to introduce standardised testing across the state to measure the ability of our 15 and 16 year old kids to confidently use computers. Every school in NSW has been required over the last few years to ensure that technology skills are integrated – or at least included – as part of the standard curriculum delivery. Our school (and I imagine most schools) have taken an approach where we have looked at the skills indicators (the specific list of computing skills that need to be assessed) and shared them out amongst the various key learning areas according to what we think are the most likely candidates to cover them in an integrated way. So, for example, our science classes try to include database use, maths integrates spreadsheets, word processing is obviously included in a number of subjects, HSIE do quite a bit with presentations, and so on. The basic idea is that by farming out the specific skills to various subjects and making their integration a mandatory requirement of curriculum delivery, that all students should get exposed to all the necessary skills by the time they get to this point in their school life. We also build in some redundancy, so that each skillset is covered by more than one key learning area.

It’s a good idea in theory. Trouble is, in theory, theory and reality are the same thing. In reality, they aren’t.

Since its inception in 2002 (I think?) the Board of Studies has been offering a “pen and paper” version of the test as well as an online version. This is designed to cater to those school who have bandwidth issues, are in rural areas, or for whatever reason decide they don’t want to do the online version. Of course, it should be obvious that a pen and paper test for computing skills is going to be pretty limited in scope. It’s all multiple guess questions, with screenshots of a generic computer GUI and fairly basic questions about how to interact with it. I was actually on the original writing committee for this test and found that we had to continually water things down – questions had to be platform agnostic (couldn’t be too Windows, Mac or Linux specific), application agnostic (couldn’t be too Microsoft Office, OpenOffice, Appleworks, or iWork specific), vague enough that they could be asked in a multiple choice format, and general enough that all kids could have a fair chance at answering them, not just the ones that did computing studies… In other words, the test had to cover all the basics but not really any of the specifics. As you can imagine, the questions that eventually emerge from that process are rather vanilla in nature. The fact that many schools still deliver the test on paper doesn’t really do much to improve the relevance of the testing process.

Mind you, the online version of the test is really no better in the sense that it is just an online version of the paper test… new bottle, same old wine. The online test has the same stimulating screen shots, same thrilling multiple choice question…  it’s nothing more than a whizzbang screen-based version of what is already available on paper, except it take a lot more effort, time and resources to administer. I’d love to see CST10 develop into an actual interactive test where kids could interact directly with simulated apps in a way that provides something close to a genuine user experience…  Don’t ask a kid how to put a border on a table by showing a static image and giving 4 choices about where you’d click to do it – give them a simulated version of a table app and ask them to SHOW YOU how they would do it.

Of course, this is hard to do. It would take huge resources to develop a test like this, and quite frankly I think it would raise all sorts of technical issues… as it was, we had some serious login issues this morning as 80,000 students across the state all tried banging on the Board of Studies servers at the same time. There needs to be a lot of further development to support this sort of load if we are ever to get online testing to work in a big way.

There are still technical issues to solve. But mainly, I’d like to see us solve some of the pedagogical issues of assessing this way. Whether we end up doing via paper or a screen, taking something as practical as computing skills and assessing them using a static, multiple choice method like this is, quite frankly, an insult to our kids.