|
Size: 906
Comment:
|
Size: 1256
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = What is the expected total rank in a R choice task? = | = What is the expected total discrepancy score in a R choice task? = |
| Line 3: | Line 3: |
| Suppose we have R choices from 1 to k and each of these is equally likely to be the true rank. The expected total rank of the absolute value of discrepancies equals | Suppose we have R possible choices and each of these is equally likely to be the true one. |
| Line 5: | Line 5: |
| $$\sum_{k=1}^R (k=1)k $$ | If we consider a discrepancy as the difference between the true choice and the one given by a subject then The expected total discrepancy of the ''absolute value'' of discrepancies equals $$\sum_{k=1}^R (k=1)k $$, $$1 \leq k \leq R $$ with the average sum of the absolute values of discrepancies per rating equal to $$\frac{\sum_{k=1}^R (k=1)k}{R}$$. |
| Line 18: | Line 26: |
| Expected total score assuming random guesses at true rank = 2(1+2+3)+2(1+1+2)= 20 = 1x2 + 2x3 + 3x4 = $$\sum_{k=1}^4 (k=1)k $$. | Expected total score assuming random guesses at true rank = 2(1+2+3)+2(1+1+2)= 20 = 1x2 + 2x3 + 3x4 = $$\sum_{k=1}^4 (k=1)k $$. The average sum of abs(discrepancies) per rating = 20/4 = 5. |
What is the expected total discrepancy score in a R choice task?
Suppose we have R possible choices and each of these is equally likely to be the true one.
If we consider a discrepancy as the difference between the true choice and the one given by a subject then
The expected total discrepancy of the absolute value of discrepancies equals
$$\sum_{k=1}^R (k=1)k $$, $$1 \leq k \leq R $$
with the average sum of the absolute values of discrepancies per rating equal to
$$\frac{\sum_{k=1}^R (k=1)k}{R}$$.
For example
R = 4
k=1 |
k=2 |
k=3 |
k=4 |
True Rank |
|||
0 |
1 |
2 |
3 |
1 |
|||
1 |
0 |
1 |
2 |
2 |
|||
2 |
1 |
0 |
1 |
3 |
|||
3 |
2 |
1 |
0 |
4 |
|||
Expected total score assuming random guesses at true rank = 2(1+2+3)+2(1+1+2)= 20 = 1x2 + 2x3 + 3x4 = $$\sum_{k=1}^4 (k=1)k $$.
The average sum of abs(discrepancies) per rating = 20/4 = 5.