Data Engineer

Data Engineers

iSoftStone, Inc. is seeking Data Engineers to join our team in Monterey Park, CA! This is an Onsite Position in Monterey Park, CA.

Summary : Despite rapid development in generative AI, quality measurement remains challenging due to the lack of reliable and robust technical metrics. This is especially the case when the slight differences in the details generated by the model could have a significant impact on user experience. In this team, we are developing a series of manual (human rating), semi-automatic, and fully automatic evaluations to measure the quality of our image and video generative models (text to image, image to video, text to video, etc.) in a variety of quality axis, including visual quality, prompt following, identity preservation, naturalness, and visual text generation and so on. To this end, we require the support of 10 additional data analysts, 5 for image in MPK (CA) and 5 for video in London, to work closely with the team to prototype and iterate on the measurements before they are scaled up.

Responsibilities

• Working with the team to prototype human rating and semi-automatic model evaluation protocols.
• For high stake and / or high complexity protocols, conduct small-to-medium scale in-house human rating on generated content.
• Working with engineers to identify and summarize model gaps based on the above evaluation
• Working with engineers to identify data needed to close those gaps and mine such data to prepare training data for the next iteration of model training
• Working with PDO teams to scale up validated evaluation protocols, including coordination and auditing.

Qualifications

Primary Location Pay Range : $27.00 - $32.00 per hour

Benefits : 1099 No Benefits

Temp hourly employee benefits, if scheduled to work at least 30 hours per week : medical, dental, vision, 401k. Temp salaried employee benefits, if scheduled to work at least 30 hours per week : medical, dental, vision, 401k, holidays.

iSoftStone is a global IT service and consulting company that creates value and drives success through technology solutions, service excellence, and digital innovation. We specialize in web and application development, software testing and support, data and content management, digital experience, accessibility, and data for machine learning and AI. With 20 delivery centers and more than 90,000 employees worldwide, iSoftStone is proud to serve some of the world's most well-known businesses, including 90+ Fortune Global 500 companies.

iSoftStone is committed to the practice of equal opportunity for all its employees and applicants in employment, and does not discriminate on the basis of race or ethnicity, color, age, national origin, religion, creed, marital status, sex, pregnancy, gender, gender identity, sexual orientation, status as an honorably discharged veteran or disabled veteran or military status, political affiliation or belief, citizenship / status as a lawfully admitted immigrant authorized to work in the United States, or presence of any physical, sensory, or mental disability. In addition, reasonable accommodation will be made for known physical or mental limitations for all otherwise qualified persons with disabilities.