<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	>
<channel>
	<title>Comments on: Normalizing Grades Across TA Sections</title>
	<atom:link href="http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/feed/" rel="self" type="application/rss+xml" />
	<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/</link>
	<description>Random samplings from a universe of ideas</description>
	<pubDate>Fri, 22 Aug 2008 00:12:21 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.5.1</generator>
		<item>
		<title>By: thomas</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306829</link>
		<dc:creator>thomas</dc:creator>
		<pubDate>Tue, 18 Dec 2007 18:12:45 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306829</guid>
		<description>&#62; This is because there is little to lose by taking some attempt to normalize.
unless the students in one section were actually better students

&#62; On the other hand, if you did not bother, a student might complain and have
&#62; a point.
cover your ass, then.  Why should you let random students decide how you grade things?  If anyone, teachers need to be independent thinkers.</description>
		<content:encoded><![CDATA[<p>&gt; This is because there is little to lose by taking some attempt to normalize.<br />
unless the students in one section were actually better students</p>
<p>&gt; On the other hand, if you did not bother, a student might complain and have<br />
&gt; a point.<br />
cover your ass, then.  Why should you let random students decide how you grade things?  If anyone, teachers need to be independent thinkers.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Michael</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306807</link>
		<dc:creator>Michael</dc:creator>
		<pubDate>Tue, 18 Dec 2007 13:38:12 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306807</guid>
		<description>oops:

...
Even if it's a small (less than 0.5), it seems to me that it may be worth it anyway. This is because there is little to lose by taking some attempt to normalize. On the other hand, if you did not bother, a student might complain and have a point.</description>
		<content:encoded><![CDATA[<p>oops:</p>
<p>&#8230;<br />
Even if it&#8217;s a small (less than 0.5), it seems to me that it may be worth it anyway. This is because there is little to lose by taking some attempt to normalize. On the other hand, if you did not bother, a student might complain and have a point.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Michael</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306806</link>
		<dc:creator>Michael</dc:creator>
		<pubDate>Tue, 18 Dec 2007 13:37:08 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306806</guid>
		<description>Julianne, you say that for a 5-6 TA course, 1 or 0 sections are normalized. I'm curious how many students have grades changed due to normalization? Even if it's a small (</description>
		<content:encoded><![CDATA[<p>Julianne, you say that for a 5-6 TA course, 1 or 0 sections are normalized. I&#8217;m curious how many students have grades changed due to normalization? Even if it&#8217;s a small (</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Robert</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306721</link>
		<dc:creator>Robert</dc:creator>
		<pubDate>Mon, 17 Dec 2007 14:31:31 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306721</guid>
		<description>No, I do not expect five different categories (here in Germany we use a grade system with six grades with two fail grades), I just meant you can usually tell if one student is much better than the other or if they are of roughly equal ability. Then I would make cuts such that there are as few borderline cases as possible. 

All the courses I have taught or graded so far had at most 30 students, not enough statistics to see a clear bi- or even multi-modal distribution. But I do have seen excellent students that still stick out clearly from the good ones. And I have seen students who should have definitely revised their choice of subject...</description>
		<content:encoded><![CDATA[<p>No, I do not expect five different categories (here in Germany we use a grade system with six grades with two fail grades), I just meant you can usually tell if one student is much better than the other or if they are of roughly equal ability. Then I would make cuts such that there are as few borderline cases as possible. </p>
<p>All the courses I have taught or graded so far had at most 30 students, not enough statistics to see a clear bi- or even multi-modal distribution. But I do have seen excellent students that still stick out clearly from the good ones. And I have seen students who should have definitely revised their choice of subject&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Belizean</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306637</link>
		<dc:creator>Belizean</dc:creator>
		<pubDate>Sun, 16 Dec 2007 05:30:21 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306637</guid>
		<description>Juliane, 

When I taught my 300-student course last spring, we solved the TA problem by having a single TA teach all 6 sections (all in one day).  We had graders to help him.  No partial credit, so no ambiguity in grading.

Where we had a problem, that I never solved, is with our quizzes.   The only way not to give the students in later sections an advantage was to make 6 different versions of each quiz, one for each section.  This was a huge pain and in hindsight a dumb idea.

After wasting so much energy on making 6 equivalent yet different version of the same quiz each week,  I was totally disinclined to run stats on the class to check for inequities due, for example, to the 1:00 pm section having 5 more hours to study than the 8:00 am section.  Or for any cheating resulting from info about the quiz topics leaking from the early sections to the later ones.

You're a saint in my view for taking the trouble to check for inequities and to adjust grades accordingly.  Me? I'm way too harried by other responsibilities and just too lazy to give a damn.</description>
		<content:encoded><![CDATA[<p>Juliane, </p>
<p>When I taught my 300-student course last spring, we solved the TA problem by having a single TA teach all 6 sections (all in one day).  We had graders to help him.  No partial credit, so no ambiguity in grading.</p>
<p>Where we had a problem, that I never solved, is with our quizzes.   The only way not to give the students in later sections an advantage was to make 6 different versions of each quiz, one for each section.  This was a huge pain and in hindsight a dumb idea.</p>
<p>After wasting so much energy on making 6 equivalent yet different version of the same quiz each week,  I was totally disinclined to run stats on the class to check for inequities due, for example, to the 1:00 pm section having 5 more hours to study than the 8:00 am section.  Or for any cheating resulting from info about the quiz topics leaking from the early sections to the later ones.</p>
<p>You&#8217;re a saint in my view for taking the trouble to check for inequities and to adjust grades accordingly.  Me? I&#8217;m way too harried by other responsibilities and just too lazy to give a damn.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: TomR</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306616</link>
		<dc:creator>TomR</dc:creator>
		<pubDate>Sat, 15 Dec 2007 23:29:23 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306616</guid>
		<description>A fun solution to an old problem.  And, as I remember from my TA days, playing with grade statistics is a lot more fun than the actual grading!

Hmmmm...so, you want to measure the lumonosity of 300 objects, and you have uncalbrated visible light measurements made by a bunch of independent amateur (but skilled) astronmers.  You then measure UV brightness for all the objects, and use that to callabrate the visible measurements.  Legit?  Seems so, unless there's some systematic variance in the visible/UV ratio.

By analogy, this system rewards students with low homework/test ratios if there's any correlation between that and section assignment. Would you think of that as a second order effect?  One could make the argument the homework/test ratio measures 'responsibility,' which is as much a parameter of individual students as 'intelligence.'

Interestingly, this should let you test hypothesises about one section being brighter than others...finaly answer that long-standing question if the brighter (or more responsible) students take the morning sections.

Robert--have you ever seen those multiple peaks in practice?  When I TA'ed classes (in economics), I'd always predict that grades would have bimodal distributions, and I was always wrong!</description>
		<content:encoded><![CDATA[<p>A fun solution to an old problem.  And, as I remember from my TA days, playing with grade statistics is a lot more fun than the actual grading!</p>
<p>Hmmmm&#8230;so, you want to measure the lumonosity of 300 objects, and you have uncalbrated visible light measurements made by a bunch of independent amateur (but skilled) astronmers.  You then measure UV brightness for all the objects, and use that to callabrate the visible measurements.  Legit?  Seems so, unless there&#8217;s some systematic variance in the visible/UV ratio.</p>
<p>By analogy, this system rewards students with low homework/test ratios if there&#8217;s any correlation between that and section assignment. Would you think of that as a second order effect?  One could make the argument the homework/test ratio measures &#8216;responsibility,&#8217; which is as much a parameter of individual students as &#8216;intelligence.&#8217;</p>
<p>Interestingly, this should let you test hypothesises about one section being brighter than others&#8230;finaly answer that long-standing question if the brighter (or more responsible) students take the morning sections.</p>
<p>Robert&#8211;have you ever seen those multiple peaks in practice?  When I TA&#8217;ed classes (in economics), I&#8217;d always predict that grades would have bimodal distributions, and I was always wrong!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Julianne</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306600</link>
		<dc:creator>Julianne</dc:creator>
		<pubDate>Sat, 15 Dec 2007 20:42:36 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306600</guid>
		<description>ts -- In a class with 5-6 TA's, I typically only have to adjust 1, or 0.   So operationally, I don't see a lot of variation.   There's probably more variation when the labs or problem sets are more open ended and free form.</description>
		<content:encoded><![CDATA[<p>ts &#8212; In a class with 5-6 TA&#8217;s, I typically only have to adjust 1, or 0.   So operationally, I don&#8217;t see a lot of variation.   There&#8217;s probably more variation when the labs or problem sets are more open ended and free form.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: ts</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306599</link>
		<dc:creator>ts</dc:creator>
		<pubDate>Sat, 15 Dec 2007 20:06:03 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306599</guid>
		<description>A very experienced instructor that I worked for a couple times as a TA kept telling me that he has never seen much variation in grading across different TAs.  From what I see, I know the attitudes toward grading among TAs do vary significantly (some try to reflect giving constructive feedback in the way they "penalize," while others just make up a scheme that allows them to grade at a maximal efficiency, etc.), so I cannot see how the variation is not significant.  Yet I mostly had to agree when the instructor told me such a variation would be so small that students can just overcome by studying only a bit harder than the typical undergrads of nowadays.</description>
		<content:encoded><![CDATA[<p>A very experienced instructor that I worked for a couple times as a TA kept telling me that he has never seen much variation in grading across different TAs.  From what I see, I know the attitudes toward grading among TAs do vary significantly (some try to reflect giving constructive feedback in the way they &#8220;penalize,&#8221; while others just make up a scheme that allows them to grade at a maximal efficiency, etc.), so I cannot see how the variation is not significant.  Yet I mostly had to agree when the instructor told me such a variation would be so small that students can just overcome by studying only a bit harder than the typical undergrads of nowadays.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: thomas</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306598</link>
		<dc:creator>thomas</dc:creator>
		<pubDate>Sat, 15 Dec 2007 18:59:17 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306598</guid>
		<description>&#62;23

Robert, do you believe in those five categories because we recognize five letter grades?  Maybe there can be seven categories, like in Newton's partition of the rainbow.  Or perhaps only three, like in the Norse partition.  That's how Professor Jackson grades his advanced math classes: you were active in the class and knew your stuff, and get an A, or you weren't all that active, were out of it for long periods, and didn't seem like you knew too much, so you get a B, or you gave up halfway through, don't know the material and get an F.

You are of course completely right about arithmetic means assuming affine structure.  Naturally, assuming each of the assignments you wrote is of equal difficulty to a student who was first exposed to the material in your class, using the arithmetic mean to determine their score is the logical way to reward effort that leads to understanding.  On the assumption that you get about the same kinds of students in each of your sections, normalizing sections is probably a good idea.  Throwing away the outliers by using the median score to normalize sections is probably even better.

One thing I'm always interested in whenever normalizing grades comes up is, how do you avoid punishing the kids who take time out of their schedules to help other students?  A simple normalization method (fitting scores to some kind of curve) would lower their scores by as much as it raises the scores of the people they help- making schooling pointlessly competitive.  Students should be encouraged to present material to each other, because teaching is just about the best way to learn.</description>
		<content:encoded><![CDATA[<p>&gt;23</p>
<p>Robert, do you believe in those five categories because we recognize five letter grades?  Maybe there can be seven categories, like in Newton&#8217;s partition of the rainbow.  Or perhaps only three, like in the Norse partition.  That&#8217;s how Professor Jackson grades his advanced math classes: you were active in the class and knew your stuff, and get an A, or you weren&#8217;t all that active, were out of it for long periods, and didn&#8217;t seem like you knew too much, so you get a B, or you gave up halfway through, don&#8217;t know the material and get an F.</p>
<p>You are of course completely right about arithmetic means assuming affine structure.  Naturally, assuming each of the assignments you wrote is of equal difficulty to a student who was first exposed to the material in your class, using the arithmetic mean to determine their score is the logical way to reward effort that leads to understanding.  On the assumption that you get about the same kinds of students in each of your sections, normalizing sections is probably a good idea.  Throwing away the outliers by using the median score to normalize sections is probably even better.</p>
<p>One thing I&#8217;m always interested in whenever normalizing grades comes up is, how do you avoid punishing the kids who take time out of their schedules to help other students?  A simple normalization method (fitting scores to some kind of curve) would lower their scores by as much as it raises the scores of the people they help- making schooling pointlessly competitive.  Students should be encouraged to present material to each other, because teaching is just about the best way to learn.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ian Paul Freeley</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306591</link>
		<dc:creator>Ian Paul Freeley</dc:creator>
		<pubDate>Sat, 15 Dec 2007 16:04:43 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306591</guid>
		<description>Orin,
I was always surprised there wasn't much correlation between time of day and grade.  I suspect that most actual learning happens outside the classroom, so when they go to class has a minimal impact on how well they do in the class.  Where it does show up is in the student evaluations, they really hate anyone who tries to talk to them in the morning.</description>
		<content:encoded><![CDATA[<p>Orin,<br />
I was always surprised there wasn&#8217;t much correlation between time of day and grade.  I suspect that most actual learning happens outside the classroom, so when they go to class has a minimal impact on how well they do in the class.  Where it does show up is in the student evaluations, they really hate anyone who tries to talk to them in the morning.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Robert</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306581</link>
		<dc:creator>Robert</dc:creator>
		<pubDate>Sat, 15 Dec 2007 12:56:19 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306581</guid>
		<description>Renormalising scores is definitely a must but I think any fixed algorithm can at best be a decent hack. I think the reason all these clever schemes eventually fail are due to the fact that scores and grades even more only have the structure of an ordered set (let's hope at least that), any further structure (affine, linear or full blown field) is typically artificial and introduced as grades are often written in terms of numbers, as these tend to be peoples favourite examples of ordered sets.

I strongly believe in the distinction along the lines of  "excellent", "very good", "fair", "just so" and "fail". And everybody can tell an excellent student when one sees one. A "good" student is obviously better than a "just so" student. But that's about what you can say about grades. Thus I think ideally the situation is as described in comment #7, each section has multi-peaked distributions and that tells you which grades the students get.

Already arithmetic averages of grades/scores are dodgy, it's not clear that "very good" is really the middle of "excellent" and "fair". I have heard people argue for example that one should compute geometric or harmonic averages but not very convincingly. Arithmetic averages requires an affine structure the others something else and usually this is not given. Julianne above argues that one should  renormalise the points deducted rather than the ones given. This is already an appreation of this fact. But this is only good for good students. If somebody writes only very little on a problem you are typically giving points for what you find and do not deduct point for what's missing.

Last week on the news I heard a report that some grades (was some business news, some costumer satisfaction measure) had improved since last year: In Germany grades are usually 1 to 6 with 1 being very good, 2 good, 3 satisfactory, 4 sufficient, 5 not sufficient and 6 complete fail. The report said that the average grade had improved from 2.5 to 2.0 . OK, they computed averages what ever those mean. But then some spokes person said that the improvement 2.5 to 2.0 was a "20% improvement" . I couldn't believe my ears. How math illiterate can you be? What is 20% of a grade supposed to mean???

I am fearing, multiplying points (deducted or given) by a renormlisation constant is not much better. It only works in a small window of grades/points. 

Ideally, your sections are large enough that you have sufficient statistics and you do a histogram in each section, identify the peaks and give grades accordingly.</description>
		<content:encoded><![CDATA[<p>Renormalising scores is definitely a must but I think any fixed algorithm can at best be a decent hack. I think the reason all these clever schemes eventually fail are due to the fact that scores and grades even more only have the structure of an ordered set (let&#8217;s hope at least that), any further structure (affine, linear or full blown field) is typically artificial and introduced as grades are often written in terms of numbers, as these tend to be peoples favourite examples of ordered sets.</p>
<p>I strongly believe in the distinction along the lines of  &#8220;excellent&#8221;, &#8220;very good&#8221;, &#8220;fair&#8221;, &#8220;just so&#8221; and &#8220;fail&#8221;. And everybody can tell an excellent student when one sees one. A &#8220;good&#8221; student is obviously better than a &#8220;just so&#8221; student. But that&#8217;s about what you can say about grades. Thus I think ideally the situation is as described in comment #7, each section has multi-peaked distributions and that tells you which grades the students get.</p>
<p>Already arithmetic averages of grades/scores are dodgy, it&#8217;s not clear that &#8220;very good&#8221; is really the middle of &#8220;excellent&#8221; and &#8220;fair&#8221;. I have heard people argue for example that one should compute geometric or harmonic averages but not very convincingly. Arithmetic averages requires an affine structure the others something else and usually this is not given. Julianne above argues that one should  renormalise the points deducted rather than the ones given. This is already an appreation of this fact. But this is only good for good students. If somebody writes only very little on a problem you are typically giving points for what you find and do not deduct point for what&#8217;s missing.</p>
<p>Last week on the news I heard a report that some grades (was some business news, some costumer satisfaction measure) had improved since last year: In Germany grades are usually 1 to 6 with 1 being very good, 2 good, 3 satisfactory, 4 sufficient, 5 not sufficient and 6 complete fail. The report said that the average grade had improved from 2.5 to 2.0 . OK, they computed averages what ever those mean. But then some spokes person said that the improvement 2.5 to 2.0 was a &#8220;20% improvement&#8221; . I couldn&#8217;t believe my ears. How math illiterate can you be? What is 20% of a grade supposed to mean???</p>
<p>I am fearing, multiplying points (deducted or given) by a renormlisation constant is not much better. It only works in a small window of grades/points. </p>
<p>Ideally, your sections are large enough that you have sufficient statistics and you do a histogram in each section, identify the peaks and give grades accordingly.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Orin</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306576</link>
		<dc:creator>Orin</dc:creator>
		<pubDate>Sat, 15 Dec 2007 10:41:10 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306576</guid>
		<description>Is there any observed correlation between student performance and the day/time of the TA section? Perhaps better students choose early classes while the worse sleep in, or it may be the other way around -- students who choose the early classes got last choice because they waited too long to pick classes. Either way, there's got to be some sort of correlation there...</description>
		<content:encoded><![CDATA[<p>Is there any observed correlation between student performance and the day/time of the TA section? Perhaps better students choose early classes while the worse sleep in, or it may be the other way around &#8212; students who choose the early classes got last choice because they waited too long to pick classes. Either way, there&#8217;s got to be some sort of correlation there&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: david nataf</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306571</link>
		<dc:creator>david nataf</dc:creator>
		<pubDate>Sat, 15 Dec 2007 08:53:05 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306571</guid>
		<description>Ian Paul Freeley,
I never complained much about my grades in undergrad, once it came in, it came in, and then that story was over. 
I was just objecting to what I perceived as an assumption of a strong correlation between GPA and intelligence. There's definitely a correlation... I was just there... but there's a lot of scatter about the mean. Among the things that mattered a lot, for example, was a person's exam schedule. Sometimes exams were well-placed, sometimes not. I remember when I had challenging, 3 hour exams, I'd be too tired for anything else that day. Fortunately, I never had 2 exams in one day. And I hope if that had happened, the professor would not have thought less of me.
The point I raised was addressed properly by the original poster, though some of the responses disturb me.</description>
		<content:encoded><![CDATA[<p>Ian Paul Freeley,<br />
I never complained much about my grades in undergrad, once it came in, it came in, and then that story was over.<br />
I was just objecting to what I perceived as an assumption of a strong correlation between GPA and intelligence. There&#8217;s definitely a correlation&#8230; I was just there&#8230; but there&#8217;s a lot of scatter about the mean. Among the things that mattered a lot, for example, was a person&#8217;s exam schedule. Sometimes exams were well-placed, sometimes not. I remember when I had challenging, 3 hour exams, I&#8217;d be too tired for anything else that day. Fortunately, I never had 2 exams in one day. And I hope if that had happened, the professor would not have thought less of me.<br />
The point I raised was addressed properly by the original poster, though some of the responses disturb me.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Julianne</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306567</link>
		<dc:creator>Julianne</dc:creator>
		<pubDate>Sat, 15 Dec 2007 06:26:07 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306567</guid>
		<description>Thomas -- I definitely sympathize with your concerns.  We all have to accept that there will never be a consistent uniform standard for grading.  So, you have to use grades as only a part of evaluating the potential of a student.  Those of us who serve on admission committees and fellowship committees do this all the time, judging patterns of grades (start weak, finish strong?), letters of recommendations, actual accomplishments, interviews, and personal statements.  The grades fit into an overall picture of a student, but are not the only means of judging.</description>
		<content:encoded><![CDATA[<p>Thomas &#8212; I definitely sympathize with your concerns.  We all have to accept that there will never be a consistent uniform standard for grading.  So, you have to use grades as only a part of evaluating the potential of a student.  Those of us who serve on admission committees and fellowship committees do this all the time, judging patterns of grades (start weak, finish strong?), letters of recommendations, actual accomplishments, interviews, and personal statements.  The grades fit into an overall picture of a student, but are not the only means of judging.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: thomas</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306562</link>
		<dc:creator>thomas</dc:creator>
		<pubDate>Sat, 15 Dec 2007 06:03:10 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306562</guid>
		<description>&#62;&#62;18
"Only the most dimwitted students would complain about normalizing section grades."

Actually, the students who end up complaining about grading styles aren't the most "dimwitted", but the most opportunistic.

The ones you thought were "dimwitted" might be attempted opportunists who just can't hack it.  Or maybe they really wanted to learn but don't have any talent.  Maybe they're in the wrong place for the wrong reason.  Ultimately, you can't save them, all you can do is try to teach them something and grade them based on whether or not they learned something or know the material... or whatever other criterion you've chosen.  At any rate, they're probably accepting whatever grade you give them, and going to their quiet place to sulk, and/or find something else to be interested in than your class.

It has been my experience that the students who talk about grading the most are the ones who get good grades for no reason.  Getting a better than deserved grade is almost as bad for a person as getting a worse than deserved grade.</description>
		<content:encoded><![CDATA[<p>&gt;&gt;18<br />
&#8220;Only the most dimwitted students would complain about normalizing section grades.&#8221;</p>
<p>Actually, the students who end up complaining about grading styles aren&#8217;t the most &#8220;dimwitted&#8221;, but the most opportunistic.</p>
<p>The ones you thought were &#8220;dimwitted&#8221; might be attempted opportunists who just can&#8217;t hack it.  Or maybe they really wanted to learn but don&#8217;t have any talent.  Maybe they&#8217;re in the wrong place for the wrong reason.  Ultimately, you can&#8217;t save them, all you can do is try to teach them something and grade them based on whether or not they learned something or know the material&#8230; or whatever other criterion you&#8217;ve chosen.  At any rate, they&#8217;re probably accepting whatever grade you give them, and going to their quiet place to sulk, and/or find something else to be interested in than your class.</p>
<p>It has been my experience that the students who talk about grading the most are the ones who get good grades for no reason.  Getting a better than deserved grade is almost as bad for a person as getting a worse than deserved grade.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ian Paul Freeley</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306558</link>
		<dc:creator>Ian Paul Freeley</dc:creator>
		<pubDate>Sat, 15 Dec 2007 05:02:36 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306558</guid>
		<description>David,
Only the most dimwitted students would complain about normalizing section grades.</description>
		<content:encoded><![CDATA[<p>David,<br />
Only the most dimwitted students would complain about normalizing section grades.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Julianne</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306552</link>
		<dc:creator>Julianne</dc:creator>
		<pubDate>Sat, 15 Dec 2007 03:44:52 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306552</guid>
		<description>Harold -- I think the engagement in labs vs test scores is what produces the scatter in the relationship, so as long as that's not systematic between sections, it should be fine.

And I too hate the fixed-percentage curve.  I work it by giving them a "minimum grade contract".  If they reach some percentage threshold, I guarantee them a given grade or better.</description>
		<content:encoded><![CDATA[<p>Harold &#8212; I think the engagement in labs vs test scores is what produces the scatter in the relationship, so as long as that&#8217;s not systematic between sections, it should be fine.</p>
<p>And I too hate the fixed-percentage curve.  I work it by giving them a &#8220;minimum grade contract&#8221;.  If they reach some percentage threshold, I guarantee them a given grade or better.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: thomas</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306551</link>
		<dc:creator>thomas</dc:creator>
		<pubDate>Sat, 15 Dec 2007 03:44:35 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306551</guid>
		<description>personally, i don't think there is a way to fairly grade ppls, because different teachers have different ideas about what they want to reward.  obviously if you just wanted to reward knowledge then simple tests would probably suffice.  if you wanted to reward creativity, you would give easy tests and hard hw's, and maybe projects.  if you wanted to reward personal growth, you could compare score on a pre-test to score on a final, but then people who just want an A without caring about your class will do the best 'cause they'll intentionally fail the pretest.  if you wanted to reward going to class, you would grade people on whether or not they came to class...

most teachers want to reward both knowledge and personal growth, so their already conflicted.  the goal of an introductory science class is both to teach some results (the earth is round, it goes around the sun, a plot of Doppler shift against distance shows that things that are far away are moving away from us...) and to teach some philosophy of science (we build theories to explain facts and make predictions regarding future observations).  some students will come to a class already knowing most of the material; perhaps they should have simply taken a test and been given credit for their knowledge, and then have taken a more interesting class?  others may have come in not knowing anything but after studying carefully they could get the material, perhaps they deserve better grades than the kids who kinda know stuff from their engineering major roommate talking and are pretty sharp sometimes, but otherwise play halo on their xboxes all day?  but talking about student archetypes isn't really a good idea because the boundary conditions are so complicated that it's hard to come up with all possible solutions that your arbitrary student will be a linear combination of.

ultimately, grading is a hard question, and while grading to optimize the number of students who end up joining your field may be a scientific question, most universities just want you to teach a completely random collection of students some tidbits from your field, which may conflict with your desire to both challenge and give an A to students who seem like they want to join your field (whence you might get profs like the dude who came up to me and shook my hand when i was hanging out with some physics majors discussing physics and physics homework in the physics lounge at my school... but when i identified as a math major told me 'i dont tlk 2 math majors').

i guess whats most interesting about the grading question is that almost every science teacher has a strong opinion on how&#38;why.  i wonder if they evaluate the grades that past teachers have given their new students based on their own criteria on how&#38;why.  when all you see on someone's gradesheet is:  B B+ A C, and it's not annotated by 'i think students should be graded on %criterion%', how useful is that?  what happens when you get a student who got a D because his professor refused to grade his homework when he answered the questions correctly, but found the answers using a technique that wasn't gone over in class or in the book?  also, higher level classes are often graded much easier than lower level classes, but not always, so you can't count on that factor.

so.  grading is hard, and the grades are then fairly meaningless.  As a student, i just go to school just to try to learn something, because it's easier to find things out when you have a teacha their to tell you stuff or ask questions of than just by reading books + wikipedia, and i don't even care about my grades.  another extreme position is that of some of my friends who are there to qualify for some other school and need A's but don't give a damn about what they're studying.

and i'm going to be pretty depressed when some bureaucrat looks at someone else's non-meaningful qualifications and selects them over me.  because of the well-known cognitive bias favoring meaningless, easy to access information, whence we get processors designed for marketing like the pentium 4 and seagate falling in line with the rest of the industry in falsifying SMART checks to make their drives look good.  or people buy sprite instead of their grocery store's lemon-lime soda even because sprite is twice as expensive, and more expensive obviously means better; besides coke is a trusted name in soft drinks (if carl went to harvard, and carlos with to umass boston, obviously carl is the better student).  and because of the need for bureaucrats to cover their asses and avoid doing things they may need to justify in the future (nobody ever got fired for buying ibm...).

so: grading is hard.  grades are pretty meaningless and may even be harmful, unless you were wanting to reward grade-grubbers at the expense of serious students.  maybe all classes should just be pass/fail on the grounds that either you learned enough to pass or you didn't?

'i am spartacus' capitalization to let everybody know im an undergrad with a learning disability.  in my case it's asperger's syndrome, and describing what that means is pretty tangential to this discussion of grades.  i just want people, when they say that it isn't and can't be their goal to grade everyone perfectly, to know who they may be allowing to slip through the cracks.  i understand its hard to give people the grades they deserve, but it's also necessary in a way that i think that many professors aren't really comfortable with assuming they think even think about it.</description>
		<content:encoded><![CDATA[<p>personally, i don&#8217;t think there is a way to fairly grade ppls, because different teachers have different ideas about what they want to reward.  obviously if you just wanted to reward knowledge then simple tests would probably suffice.  if you wanted to reward creativity, you would give easy tests and hard hw&#8217;s, and maybe projects.  if you wanted to reward personal growth, you could compare score on a pre-test to score on a final, but then people who just want an A without caring about your class will do the best &#8217;cause they&#8217;ll intentionally fail the pretest.  if you wanted to reward going to class, you would grade people on whether or not they came to class&#8230;</p>
<p>most teachers want to reward both knowledge and personal growth, so their already conflicted.  the goal of an introductory science class is both to teach some results (the earth is round, it goes around the sun, a plot of Doppler shift against distance shows that things that are far away are moving away from us&#8230;) and to teach some philosophy of science (we build theories to explain facts and make predictions regarding future observations).  some students will come to a class already knowing most of the material; perhaps they should have simply taken a test and been given credit for their knowledge, and then have taken a more interesting class?  others may have come in not knowing anything but after studying carefully they could get the material, perhaps they deserve better grades than the kids who kinda know stuff from their engineering major roommate talking and are pretty sharp sometimes, but otherwise play halo on their xboxes all day?  but talking about student archetypes isn&#8217;t really a good idea because the boundary conditions are so complicated that it&#8217;s hard to come up with all possible solutions that your arbitrary student will be a linear combination of.</p>
<p>ultimately, grading is a hard question, and while grading to optimize the number of students who end up joining your field may be a scientific question, most universities just want you to teach a completely random collection of students some tidbits from your field, which may conflict with your desire to both challenge and give an A to students who seem like they want to join your field (whence you might get profs like the dude who came up to me and shook my hand when i was hanging out with some physics majors discussing physics and physics homework in the physics lounge at my school&#8230; but when i identified as a math major told me &#8216;i dont tlk 2 math majors&#8217;).</p>
<p>i guess whats most interesting about the grading question is that almost every science teacher has a strong opinion on how&amp;why.  i wonder if they evaluate the grades that past teachers have given their new students based on their own criteria on how&amp;why.  when all you see on someone&#8217;s gradesheet is:  B B+ A C, and it&#8217;s not annotated by &#8216;i think students should be graded on %criterion%&#8217;, how useful is that?  what happens when you get a student who got a D because his professor refused to grade his homework when he answered the questions correctly, but found the answers using a technique that wasn&#8217;t gone over in class or in the book?  also, higher level classes are often graded much easier than lower level classes, but not always, so you can&#8217;t count on that factor.</p>
<p>so.  grading is hard, and the grades are then fairly meaningless.  As a student, i just go to school just to try to learn something, because it&#8217;s easier to find things out when you have a teacha their to tell you stuff or ask questions of than just by reading books + wikipedia, and i don&#8217;t even care about my grades.  another extreme position is that of some of my friends who are there to qualify for some other school and need A&#8217;s but don&#8217;t give a damn about what they&#8217;re studying.</p>
<p>and i&#8217;m going to be pretty depressed when some bureaucrat looks at someone else&#8217;s non-meaningful qualifications and selects them over me.  because of the well-known cognitive bias favoring meaningless, easy to access information, whence we get processors designed for marketing like the pentium 4 and seagate falling in line with the rest of the industry in falsifying SMART checks to make their drives look good.  or people buy sprite instead of their grocery store&#8217;s lemon-lime soda even because sprite is twice as expensive, and more expensive obviously means better; besides coke is a trusted name in soft drinks (if carl went to harvard, and carlos with to umass boston, obviously carl is the better student).  and because of the need for bureaucrats to cover their asses and avoid doing things they may need to justify in the future (nobody ever got fired for buying ibm&#8230;).</p>
<p>so: grading is hard.  grades are pretty meaningless and may even be harmful, unless you were wanting to reward grade-grubbers at the expense of serious students.  maybe all classes should just be pass/fail on the grounds that either you learned enough to pass or you didn&#8217;t?</p>
<p>&#8216;i am spartacus&#8217; capitalization to let everybody know im an undergrad with a learning disability.  in my case it&#8217;s asperger&#8217;s syndrome, and describing what that means is pretty tangential to this discussion of grades.  i just want people, when they say that it isn&#8217;t and can&#8217;t be their goal to grade everyone perfectly, to know who they may be allowing to slip through the cracks.  i understand its hard to give people the grades they deserve, but it&#8217;s also necessary in a way that i think that many professors aren&#8217;t really comfortable with assuming they think even think about it.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Clark</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306545</link>
		<dc:creator>Clark</dc:creator>
		<pubDate>Sat, 15 Dec 2007 02:39:40 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306545</guid>
		<description>I propose that we use the terms "K- and M-type" to refer to those students who do not shine as brightly as the others.</description>
		<content:encoded><![CDATA[<p>I propose that we use the terms &#8220;K- and M-type&#8221; to refer to those students who do not shine as brightly as the others.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Harold</title>
		<link>http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306541</link>
		<dc:creator>Harold</dc:creator>
		<pubDate>Sat, 15 Dec 2007 01:50:48 +0000</pubDate>
		<guid isPermaLink="false">http://cosmicvariance.com/2007/12/14/normalizing-grades-across-ta-sections/#comment-306541</guid>
		<description>Hi Julianne,

I think this is one of the best ideas I've seen for normalizing across TA sections. But what if the TA is teaching a lab, and some students find labs more engaging and do better there than on their exams? 
There seems to me something fishy about having one their exams influence their section grades. They should be separate - yet I can't find a cure for normalizing across TA sections.
The way they do it at my school is that 35% get A's, 35% get B's and the rest get the rest of the grades. I don't like this at all, since I know more students deserve A's.</description>
		<content:encoded><![CDATA[<p>Hi Julianne,</p>
<p>I think this is one of the best ideas I&#8217;ve seen for normalizing across TA sections. But what if the TA is teaching a lab, and some students find labs more engaging and do better there than on their exams?<br />
There seems to me something fishy about having one their exams influence their section grades. They should be separate - yet I can&#8217;t find a cure for normalizing across TA sections.<br />
The way they do it at my school is that 35% get A&#8217;s, 35% get B&#8217;s and the rest get the rest of the grades. I don&#8217;t like this at all, since I know more students deserve A&#8217;s.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
