EdD: KoLL & Test Validity. Probably.

I turned in a slightly new direction on Monday. The "migration crisis" which dominates the news, (and the thoughts of many of us) has skewed my focus. What I'm looking at is the other end of the formal "migration" process, the claim for ILR, or application for citizenship, where the language testing is actually taking place. And it needs to be kept close to test validity.

Let's assume for the moment that I'm going with the consequential model of test validity, per Bachman & Palmer (2010) and Chalhoub-Deville (2015), (which is not to say that I've made any kind of binary choice between them and Kane, 2013).

So, it needs to be shown, (note use of passive), that the (currently) B1 CEFR Speaking & Listening test, being the language component of KoLL, has beneficial consequences. Now, it may be shown that achieving the cut score has benefits for the test taker. But what about a failure?  See, if someone fails to get their 6.5 in IELTS, say, and doesn't get their UK University place, then that's still a beneficial consequence for all of the stakeholders because time, money and emotional input won't be wasted. But what beneficial consequences flow from success or failure to reach the cut score for KoLL?

It might be necessary to widen this, and look at KoLL as a whole, that is include also the Life in the UK test. Alternatively, if it's looking unwieldy, and I want more manageable populations for the qualitative data, and a deeper language test focus, there are the B2 tests for Ministers of Religion. But, whatever, the heart of it must be test validity. 


REFS:


Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford, UK: Oxford University Press. 
 
Chalhoub-Deville, M. (2015). Validity theory: Reform policies, accountability testing, and consequences. Language Testing. http://doi.org/10.1177/0265532215593312 

 
Kane, M. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1–73

Comments

Post a Comment

Popular posts from this blog

Leech or flatworm? Ants and Swiss Chard

Image
For the 2nd time in a week or so, (1st time regarding dwarf beans ), I'm following Alys Fowler's advice, this time with regard to Swiss chard .  Long story short, after midsummer plants which often bolt if planted in spring will resist the impulse to do so, probably because of shortening days; (I say shortening, but in Glasgow, in July, we're still getting 18 hours of daylight).   I got a packet of Bright Lights , at a good price, (another reason to wait until July before sowing, lots of bargains, I've noticed). But where to sow them? Most of the 2nd bed is under a tarpaulin, but it wasn't quite big enough to cover the whole bed, so the last 5ft or so went under a sheet of plastic, (in the background of the photo in this post, here .) Transparent plastic was a foolish idea, weeds were growing underneath it, so I covered most of it with sheets of metal from the old shed. I decided to leave the tarp, but use the area beneath the plastic for the chard. Who-ah there
Read more

LTPTP XXV: We Shall Overcome

Image
We shall indeed.  It's a lovely wee tune to learn.  I've almost memorized it this morning, the idea being, when I encounter a piano, I want something to sit down and play on the bugger.  I've a feeling that my keyboard's keys are lighter than a proper piano's, and there'll be a bit of effort transferring the skills I've gotten so far.  Probably, at some point this year, I'll be in workplace with a piano.  I'll print off some simple music and scales, and work at it, but it's likely to be in a public place so I want something to avoid making a twat of myself initially. It feels right that this should be the first tune I learn by heart.
Read more

"Chevy Chase. Fuck ever happen to him?"

Image
As Paulie Walnuts said in The Sopranos. It got me thinking. As it happens, he's been working steadily , but you can see what Paulie means. It's like that with film and television actors: you don't see them in anything for a year or two, and you wonder if they're dead or perhaps on a lengthy charlie and booze session. Or maybe doing proper acting on the stage? Only appearing on the telly gives them meaning to us. That video with Paul Simon was on one of the cable music channels the other day. It always makes me smile. As for Paulie and the rest of the crew, the clock's ticking. Of course, America already knows how things finish, but we don't. My mate Ian was telling me about a friend of his, visiting the States a few weeks ago, flicking through the channels in his hotel bedroom, he hit on a repeat of THE final episode, just beginning. What a quandry! He watched it, as it goes, but kept shtum when he came home.
Read more