Job Description
About Al Data Service and Operations (ADSO) Team
The Al Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.
We are seeking a Training & Quality Specialist to directly support our Prompt Engineering team, which is responsible for crafting and optimizing prompts that guide Al models toward high-quality outputs. This role is critical in maintaining the consistency, accuracy, and excellence of prompt writing through targeted quality auditing, data-driven insights, and impactful training initiatives. As a key partner to the Prompt Writers, you will be responsible for evaluating written outputs for alignment with internal guidelines, conducting root-cause analysis to identify trends or gaps, and developing responsive training materials to address areas for improvement. You will also play a vital role in onboarding new writers, driving policy comprehension, and promoting a strong quality culture across the team.
Responsibilities
• Audit Prompt Writer outputs to ensure alignment with complex policy guidelines, stylistic standards, and quality benchmarks, delivering clear feedback and actionable insights.
• Analyze performance data and error trends using both quantitative and qualitative methods to proactively identify quality gaps and implement corrective strategies.
• Partner with Prompt Writers, team leads and cross-functional teams, to maintain a consistent understanding of quality expectations and ensure calibration across teams.
• Develop, deliver, and maintain structured training programs including onboarding, policy refreshers, and upskilling modules tailored to Prompt Engineering needs.
• Regularly review and update training content and documentation to reflect evolving policies, best practices, and model capabilities.
• Support experimentation efforts by advising on quality criteria for prompt iterations and assisting with the documentation of prompting strategies and results.
• Collaborate cross-functionally with Policy, Product, and Engineering teams to address quality-related concerns and support continuous improvement initiatives.
• Maintain high documentation standards around audit records, training progress, and improvement plans to ensure traceability and accountability.
• Contribute to ad hoc quality and governance projects to elevate content integrity and team performance.
• Please note that this position involves exposure to sensitive content, including but not limited to vulgar content, violence, pornography, and fake news.
