0

When I just started translating here at Gengo, all my work got reviewed by senior members and my score was always 10, but after a while, I stopped receiving reviews (I assumed it was because I wasn't "new" anymore). My overall quality rating was still 10 though, so at the time I didn't give it much thought. Some time later, however, I was surprised to see that I had once again received a review and even more so because this time my score was 9.? (I don't remember the exact score, but it was nine point something). Ever since then, I have sporadically been receiving reviews, but always only for jobs with a few very minor mistakes (like a missing colon or an accidental, dumb typo). This has caused my overall quality rating to drop to 9.5, which still isn't bad of course, but since I never get reviews for my jobs without mistakes anymore, there is no way for me to get my rating back to 10.

 

So, my point is that I only seem to receive reviews when I've made (minor) mistakes and never when my work is "flawless". Is this how it's supposed to be? To be honest, I find this system very discouraging. I know I'm not perfect, but I do my best to submit good translations and I honestly think that most of my work is without the kind of mistakes that I'm now getting low scores for. Everyone makes little mistakes every now and then, even the best among us. That's just something you can't avoid.

 

I'm not sure if there's any point in posting this here, but I just wanted to get it off my chest.

 

On a semi-related note: the suggested translations for many jobs are often clearly incorrect (especially when it comes to punctuation) and we as translators have to correct or adjust them a lot. I think at least some of my mistakes can be traced back to this (like the missing colon I mentioned before).

 

(I searched these forums for similar threads but I could only find semi-related posts from 2015 or even longer ago, so I decided to start a new discussion.)

 

 

6 comments

  • 0
    Avatar
    mirko

    Actually, the people carrying out reviews aren't "senior members" in the sense they've been translating here for a long time and "got promoted" to the role of reviewer. They're people specifically and separately hired by Gengo for that purpose, and I'm not sure they're also translators here... (in this respect their title of "senior translators" is a bit misleading, IMO)

    As for the reviews, I really don't think they're purposefully choosing jobs containing mistakes... (at least, that's not my experience).

    Reviews are carried out at more or less regular intervals, and I guess the jobs that gets reviewed are randomly chosen among the most recent ones.

  • 0
    Avatar
    Lara Fernandez

    Hi @Quesada!

    @mirko already explained how the system works but I just wanted to confirm that his information is correct: reviews are carried out at more or less regular intervals, and reviewed jobs are selected at random from each translator's most recently completed jobs. We do not review all completed jobs by each of our translators.

    You can read more about our Quality process here :)

    Hope this helps,

    Lara

  • 0
    Avatar
    Quesada

    Thanks for the answers and explanations! Good to know that what I assumed wasn't entirely correct. I'll just keep on doing my best then and hope that I'll get a better score next time one of my jobs is reviewed.

     

    Thanks again :)

  • 0
    Avatar
    kvstegemann

    Quesada, as you can see from the link Lara provided, your current score average is the (weighted) averare of your last 20 scores. That means also that a lower score does not remain forever with you. As soon as you got 20 tens in a row, your overall score is ten again.

    However, I do believe that mostly small jobs are selected for reviews. I think I have never seen one of my many longer jobs or file jobs selected for a review. And that means that any error occurring in your translation will weigh rather heavily, because it is measured by word count. One mistake in a short translation is worse than one mistake in a longer translation.

  • 0
    Avatar
    mirko

    kvstegemann wrote: "However, I do believe that mostly small jobs are selected for reviews".

    That's my experience as well, and I brought this up with Gengo more than once in the past. Also, since there are a lot of jobs "collections" around, when a review involves one of those, only a single "segment" of the collection is used for the review, and that usually is a few words too...

    I believe they should find a way to review BOTH short and long jobs in equal measure (and/or not just review a 10 words segment out of a 3k "collection", for instance). Also, the number of reviews concurring to the score has been brought from 5 to (10 to) 20, and perhaps 20 is a bit too much, also considering that usually (in my experience) reviews are carried out at intervals of 1 to 2 months one from the other, so 20 reviews basically means 20 to 40 months worth of reviews, which is quite a long time. I thought 10 was a better compromise. At any rate, that's not a big issue.

  • 0
    Avatar
    Quesada

    Ah, I see. I guess the system is not perfect then, but in the end the only thing I (we) can do to get a good overall score is simply trying not to make mistakes. At least it is good to know that my score can go up again. Thanks for shedding some light on how the system works.

Please sign in to leave a comment.