Several hours ago, I received e-mail from Gengo's team, which states that from now on, translators will be evaluated with not only scorecard, but also, with "consistency score".
They explain that this "consistency score" is set up for evaluating consistency of translation quality. For instance, if your last 3 GoCheck scores are "7.0", "7.0", "7.0", your average score is "7.0". Meanwhile, if your last 3 GoCheck scores are "10.0", "10.0", "1.0", your average score is sitll "7.0", but your "consistency score" will be signicantly lower than the previous case (at least, I understand Gengo's explanation as so).
Well, the concept is understandable. Any customer should be able to expect consistent quality of translation, of course.
But seriously, why does Gengo team make such important change without making any prior notice? They say that this "consistency score" will be used for evaluation of translators.
I have searched across twitter, blog post, support page etc., but no information whatsoever was found about this "consistency score".
Besides, it makes situation very hard for translators to keep his/her status as translator.
Along with "consistency score", new "performance dashboard" was revealed. Surprisingly, scores of (probably) every translators of Gengo can be checked from it from now on. I have checked scores of several translators.
To my surprise, many translators with above 8.0 (or sometime 9.0) on his/her scorecard, receive below 7.0 for "consistency score". Such persons received some low score (below 6.0) few times, which makes his/her consistency score significantly lower than his/her "scorecard".
As far as I heard, if your "consistency score" becomes below 7.0, your status as Gengo translator is at risk. In short, even when your scorecard shows above 8.0 or 9.0, when you make even one bad mistake in any of your job, you are in trouble from now on.
Anyway, I wish to ask Gengo's team about specific explanation about this "consistency score". How it is calculated, how it will exactly affect my translator status, etc.
I myself am currently contacting with Gengo's support team about it, but thought that it would be good idea to share this information with you all.