Lead QA engineers (AI)

Role: AI Tester
Rate: Inside IR35
Location: Remote with occasional travel to Croydon
Duration: 6 months initially
SC Clearance or Eligible

Job Spec for AI Tester

• Strong understanding of machine learning concepts, algorithms and deep learning models to effectively test AI applications.
• Strong understanding of use cases such as classification, text generation, text summarisation.
• Good understanding of data quality and pipelines (Data and ML Pipelines).
• Software testing experience focusing on AI testing, AI test planning including creation of AI test strategies and test plans.
• Experience with testing Generative AI and Natural Language Processing (NLP) systems.
• Experience in model evaluation and model testing.
• Experience with model stacking and model integration testing of AI Machine Learning models for quality, robustness, and performance.
• Experience of Machine Learning testing for anomaly detection using Python libraries.
• Familiarity with AI frameworks and tools like TensorFlow, PyTorch, Keera or similar.
• Proficiency in programming languages such as Python, Java or others used in AI.
• Experience testing with models such as BERT, Meta LLAMA and XGBOOST.
• Strong understanding of model evaluations including model overfitting and underfitting.
• Experience with API testing on endpoints and data exchange formats.
• Experience with version control systems like GIT to manage and track changes to AI codebase.
• Familiarity with metrics related to model classifications and an ability to analyse dashboards provided by cloud native services.
• Understanding of cloud computing platforms like AWS and Azure.
• Effective communication to work collaboratively with cross functional teams including developers and data scientists.

Key AI areas & models used in Automation Centre

• Azure models specific to Classification: XGBOOST
• AWS SageMaker specific to Summarisation: Meta LLAMA 30B
• Hugging Face models on Azure
• BERT for text generation or data creation

LA International welcomes applications from all sections of the community and from people with diverse experience and backgrounds.