Comments for Slowly, but Surely:- Hi Justus, Thank you for your prompt reply. I have sent you an email with the additional info. Best regards, Isabelle

Comments for Slowly, but Surely:- A few more questions: Do you want to make an inference from a subset of cases, which you will have both judges rate, to all cases that you have data for? Or Do you want to make an inference from all cases you have data for to the universe of possible cases? Or Do you want to make an inference to all judges from the judges you have chosen? Justus

Comments for Slowly, but Surely:- Hi Isabelle, I'm not sure what you mean by "sample estimate" in the sentence: "estimating sample size for significance tests for kappa, but nothing on what would be considered appropriate if kappa were to be simply used as the sample estimate." Please explain. Could you send me the papers you referred to by e-mail and I'll try to see what you mean. I'm guessing that you could use those formulas or tables there if you are using Cohen's kappa to estimate the inter-rater reliability of your scale. You might also want to check out generalizability theory. That might be another method of answering your question, if you want to think of raters as random factors.

Comments for Slowly, but Surely:- Dear Justus, I have come across your website with the online kappa calculator, which seems like a fantastic resource. However, unlike the other users of your blog, I am not yet at the stage of data analysis, my question is much more preliminary. My research project investigates risk factors for suicide attempts. As part of it, I have developed a rating system to determine whether or not a given incident of self harming behaviour constitutes a suicide attempt. Accordingly, an event can be classed as a suicide attempt, not a suicide attempt, or undetermined. Despite an intensive literature search, I have not been able to work out what would be an adequate sample size of the vignettes to be rated and the number of judges for calculating kappa. The papers I have read on the sample size requirements (e.g., Cantor, 1996; Flack et al., 1988; Sim & Wright, 2005) provide formulae or tables for estimating sample size for significance tests for kappa, but nothing on what would be...

Comments for You can always change this later.:- Some interesting predictions about EdTech year 2007, made by Roman: http://cs.joensuu.fi/~rbednari/blog/index.php/a-look-at-the-2007-edtech Can you imagine what could be ahead, let's say at 2011, or even in the second half of 2010?

Comments for You can always change this later.:- [...] feed. You can leave a response, or trackback from your own site. Leave a Reply. Name (required) ...You can always change this. Blog Archive Meet me at the ...Meet me at the CS dept. store. After reading this article about how cool it is even for ... one of [...]

Comments for You can always change this later.:- [...] [...]

Comments for You can always change this later.:- It's been a great exercise to rethink about the last 8-9 years. i think your pearls summarize them pretty well :)