NOT RECOMMENDED: opiniones de empleados con el puesto de LLM Evaluator en Innodata

Great place to work with consistent communication.

Days can get repetitive and dry

The vast majority of the people I worked with on projects for a major internet company were friendly and educated. The pay was decent for trivial remote work.

Projects were tedious at best and seemed poorly designed. Rubrics designed either by the contracting company or Innodata were often poorly thought through, and rules tripped over themselves or remained ambiguous. The company we were sub-contracted to was infamous for not replying to inquiries asking for clarification for how to evaluate the AI. Prompts given to the AI were often incoherent--just a word or name, often misspelled--which left us making arbitrary decisions about how well the AI addressed the prompt. Rubrics were hidden from employees evaluating the AI, though that seemed to be a result of neglect by a company still figuring out how to run things, not an active decision to deceive employees. I left well before the recent waves of layoffs. Management had tried to assure us that jobs were secure, but that seemed delusional given that the contracting company was farming out work through other companies rather than hire us itself.