Data QA Specialist

The Specialist – Data QA vacancy at Almosafer in Amman, Jordan, is about testing the quality of data, machine learning models and generative AI applications. Day to day, that means SQL and Python checks on data, automated testing frameworks, and reviewing LLM and RAG responses for accuracy and hallucinations.

Data QA specialist jobs in Amman: what the Almosafer post involves

In its About the Role section, the ad calls for a Data Scientist & Data QA Engineer and states the purpose as making sure the company’s data, AI and machine learning solutions hold up on quality, reliability and performance.

Responsibilities

• Designs and runs data quality checks that test whether data is accurate, complete and consistent, along with source-to-target validation and reconciliation
• Investigates anomalies with SQL and Python
• Builds automated testing frameworks and backs regression testing for ML solutions and data in production
• Checks AI and ML models against the business requirements they serve, reviews outputs for inconsistencies, and helps test model performance, data drift, bias and reliability together with data scientists and ML engineers
• Tests GenAI, LLM and RAG application responses for accuracy and factuality, spots hallucinations and bias, and runs prompt-based and scenario-based tests
• Develops test data for continuous quality monitoring of those applications
• Sets quality standards, test strategies and acceptance criteria jointly with data scientists, data, ML and software engineers and product teams, and traces defects to their root cause

Requirements

• Experience in at least one of Data QA, data science, data engineering, machine learning or AI/ML testing
• Strong Python and SQL programming skills, plus automated testing experience, preferably with PyTest or similar frameworks
• A solid base in machine learning fundamentals and in data quality concepts
• Strong knowledge of prompt engineering, shown in designing prompts for AI and LLM applications and evaluating them
• Working knowledge of MCP (Model Context Protocol) servers and of how they plug into AI and LLM applications
• Experience with skills files and AI agent configuration and instruction files, including how they guide AI workflows, and hands-on experience with Claude Code or similar AI-assisted development tools
• Strong analytical, problem-solving and communication skills
• A related field is accepted for the degree

Preferred qualifications

• Hands-on work with generative AI, LLM applications and RAG architecture, and with AI evaluation frameworks such as Ragas, TruLens or DeepEval
• Familiarity with LLM platforms such as OpenAI, Anthropic and Llama, and with data and model drift and bias monitoring
• Experience with cloud platforms such as AWS, Azure or GCP, and with CI/CD processes

About Almosafer

Almosafer Travel & Tourism Co describes itself as the leading travel company in Saudi Arabia, serving millions across the travel and tourism sector. Its name is Arabic for “traveler”, and its teams are spread across Saudi Arabia and the wider region.

How to apply

Applications go through the job listing on Almosafer’s careers site: apply using the button below.