Test Lead (AI Testing)

Tescom is an ITconsulting firm providing a range of professional services in functionaltesting, automation testing, cybersecurity testing, performance testing,independent IT auditing, usability testing, resource augmentation, IT supportand training.

We are looking to hirea Test Lead to join us in our projects involving Artificial Intelligence(AI) and Machine Language (ML) systems.

Responsibilities

1. AI Strategy& Framework Design: Define the overall Test Strategies/Plans forAI/ML systems, including the validation of training data, model performance,and post-deployment monitoring frameworks.

2. TeamLeadership:Guide and mentor, a team of Test Analysts, onshore and offshore, fosteringexpertise in both traditional automation frameworks (e.g.,Playwright/TypeScript) and AI-specific testing methodologies.

3. ModelValidation:Establish metrics and test protocols for model accuracy, drift, bias, fairness,and robustness against adversarial inputs.

4. QualityAuditing:Work with Developers, Data Engineers and Data Scientists to audit and validatedata pipelines, ensuring data integrity, proper labeling, and compliance withregulatory standards.

5. Risk-BasedTest Prioritization: Apply risk-based testing principles tobalance comprehensive model validation with agile delivery timelines,identifying critical failure modes before production.

6. ClientStakeholder Management: Act as the primary technical liaison forclient stakeholders, translating complex, probabilistic AI testing metrics(such as confidence scores, data drift, and bias risks) into clear,business-focused risk assessments. Manage client expectations regarding theinherently non-deterministic nature of AI systems and provide transparentgovernance reports and audit-ready test evidence to build trust in modelreliability.

Qualifications& Experience

1. Education: Bachelor'sdegree in information technology, computer science, or a related field.

2. Testing Experience: At least 8+years of experience in software testing and test management of IT systems, witha strong foundation in core testing methodologies (ISTQB standards preferred).

3. SDLC Knowledge: Strongunderstanding of IT project management methodologies (e.g., Agile, Waterfall)and software development life cycles.

4. TestingLeadership:3+ years of leadership experience in a Senior Test Analyst or Test Lead role.

5. AI/ML DomainKnowledge:At least 2+ years of experience in testing AI systems, LLMs, or predictivemodels. Familiarity with various model evaluation concepts (e.g.,precision/recall, F1 score, confusion matrices, data drift).

6. TechnicalProficiency: Strong programming skills in Python or TypeScript, andhands-on experience with automated testing tools like Playwright and CI/CDpipelines.

7. Regulatory& Compliance Awareness: Understanding of AI regulatory and governance frameworks (such as Singapore AI Verify, EU AI Act), data privacy regulations (such as GDPR, Singapore PDPA), and emerging AI governance standards.

8. Communication: Exceptional ability to bridge the gap between data science teams, software developers, and business stakeholders.

9. Technical Certifications: Candidates with ISTQB Certified Tester Foundation Level(CTFL) and AI-related certifications, would have an advantage.