Software Engineer
The Judge Group
Software Engineering
Irving, TX, USA
Senior AI Test Engineer (Manual & Automation)
IAM Tools Engineering (ITE)
Location: Irving, TX (Las Colinas) | Chandler, AZ | Minneapolis, MN
Employment Type: Contract (Contingent), with potential for conversion
About the Role
The IAM Tools Engineering (ITE) team is seeking a Senior AI Test Engineer to lead quality engineering efforts for our AI-enabled, self-service identity and access management platform. In this role, you will define and execute testing strategies across complex, distributed systems, ensuring high quality, reliability, and scalability.
As a senior individual contributor, you will own end-to-end testing across UI and API layers, influence engineering best practices, and serve as a trusted quality partner to product and engineering teams. You will also help shape modern, scalable test automation solutions aligned with CI/CD delivery models and collaborate closely with globally distributed QA teams.
Responsibilities
- Define, own, and execute the overall test strategy, including functional, integration, system, API, and UI testing, aligned with business, security, and AI quality objectives.
- Design, implement, and maintain scalable and maintainable test automation frameworks for:
- UI automation
- API automation
- Perform hands-on automation development and targeted manual testing, particularly for complex, high-risk, or AI-driven scenarios.
- Integrate automated tests into CI/CD pipelines (e.g., Jenkins, GitHub Actions) to enable continuous quality validation.
- Validate AI-enabled capabilities, including:
- Data quality and integrity
- Model output accuracy, behavior, and consistency
- (Optional) Conversational AI and chatbot testing
- Partner with product managers and software engineers early in the development lifecycle to ensure testability, clear acceptance criteria, and high-quality design.
- Provide technical leadership and mentorship to junior and offshore QA engineers.
- Collaborate effectively with globally distributed teams to ensure consistent quality standards and execution.
- Proactively identify quality, reliability, and performance risks and drive mitigation before production release.
Minimum Qualifications
- 5+ years of experience in software quality engineering or software testing for complex, web-based applications, or equivalent practical experience.
- Demonstrated experience owning end-to-end quality outcomes as a senior individual contributor.
- Strong hands-on experience with manual testing and advanced test automation.
- Experience building and maintaining UI and API test automation.
- Hands-on experience with Playwright (preferred) or equivalent modern automation frameworks, with the ability to adopt Playwright quickly.
- Experience with Selenium WebDriver.
- Proficiency in C# or similar object-oriented programming languages.
- Experience applying BDD principles and writing scenarios using Gherkin.
- Experience integrating automated tests into CI/CD pipelines.
- Solid understanding of functional, integration, system, end-to-end, and non-functional testing.
- Experience using Git-based version control systems.
- Excellent written and verbal communication skills, with the ability to influence across a matrixed organization.
- Proven ability to collaborate effectively with both onshore and offshore teams.
Preferred Qualifications
- Experience with performance testing, including load, stress, and endurance testing.
- Hands-on experience with JMeter, BlazeMeter, or similar performance testing tools.
- Experience with SpecFlow and/or Reqnroll.
- Familiarity with Micro Focus ALM Octane or similar test management tools.
- Experience executing tests at scale using platforms such as LambdaTest HyperExecute.
- Experience testing cloud-native applications on AWS, Azure, or Google Cloud Platform.
- Working knowledge of AI/ML concepts, including NLP and data-driven systems.
- Experience testing AI-powered chatbots or conversational interfaces.
- Familiarity with AI-assisted development or testing tools (e.g., Microsoft Copilot).
Education
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Equal Opportunity Statement
We are committed to building a diverse and inclusive workforce. All qualified applicants will be considered without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, or disability.