- RedRock Consulting
- United Kingdom, Cumberland
- Full-Time
- 11 days ago
SC Cleared Automation Tester (AI / LLM Testing).
Before you go
Before you leave us, sign up for our email alerts
We don't do job spam, just the best digital jobs delivered straight to your inbox.
SC Cleared Automation Tester (AI / LLM Testing): our view in 3 lines...
- The Role:This role is for a tester who checks the quality of software and AI systems on a large digital programme.
- The Person:The person will define and implement the test strategy, build automated testing into CI/CD pipelines, create Python test frameworks, validate AI and LLM outputs, and manage defects and release support.
- Requirements:The ideal candidate has a proven background in Automation Testing or Quality Engineering, strong Python test automation experience, and experience with Playwright, Selenium, PyTest or similar frameworks.
About the role
SC Cleared Automation Tester (AI / LLM Testing)
Location: UK Based
Clearance: Active SC Clearance Required
Rate: Competitive Day Rate
We're supporting a major digital transformation programme and are looking for an SC Cleared Automation Tester with a passion for quality engineering and emerging AI technologies.
This is a fantastic opportunity to join a highly skilled delivery team working on innovative solutions that incorporate Artificial Intelligence, Large Language Models (LLMs) and advanced automation practices.
The Role
You'll play a key role in shaping the testing strategy from day one, ensuring quality is embedded throughout the development lifecycle. Working closely with developers, architects and stakeholders, you'll help build robust automated testing into CI/CD pipelines while validating both traditional software components and AI-driven capabilities.
Key responsibilities include:
- Defining and implementing the overall test strategy and approach
- Building automated testing into CI/CD pipelines
- Creating and maintaining automated test frameworks using Python
- Designing and executing integration, regression and end-to-end testing
- Validating AI and LLM-based outputs for quality, consistency and reliability
- Developing repeatable test harnesses and test datasets
- Managing defects and supporting release activities
- Producing clear, traceable and auditable test evidence
- Supporting assurance activities and user acceptance testing
- Collaborating within Agile delivery teams throughout each sprint
Required Experience
- Proven background in Automation Testing or Quality Engineering
- Strong Python test automation experience
- Experience with Playwright, Selenium, PyTest or similar frameworks
- CI/CD pipeline experience (Azure DevOps, GitHub Actions, Jenkins or similar)
- Integration, API and regression testing experience
- Strong understanding of Agile delivery environments
- Experience working within secure, regulated or government environments
- Active SC Clearance
Highly Desirable
- Experience testing AI, Machine Learning, LLM or Generative AI solutions
- Experience with RAG (Retrieval Augmented Generation) applications
- AI evaluation, prompt testing or model validation experience
- Synthetic test data creation and management
- Cloud platform experience (AWS or Azure)

