2013/2014 Sr QA Automation Engineer - AI First
Jornada completa
In All Media Inc
Teletrabajo
- Trabajo remoto
Position: Senior QA Automation Engineer (AI-First)
Location: Remote
Contract Type: Full-time vendor (Direct contract with Inallmedia.com)
Time Zone Alignment: Central Time (CT) ±2 hours
About Inallmedia.com
Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams across LATAM. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.
Project Overview
You will join a forward-thinking engineering team building an innovative data center power management platform designed to optimize energy consumption and relieve grid pressure. As a Senior QA Automation Engineer (AI-First) , your primary focus will be designing, building, and enforcing a robust automated testing strategy across distributed systems, Python microservices, event pipelines, and non-deterministic agentic AI workflows.
Key Responsibilities
- Comprehensive Test Strategy: Own the automated test strategy across unit, integration, contract, end-to-end, and edge-deployment validation.
- UI & Workflows: Build and maintain end-to-end test suites in Playwright for operational UIs and human-in-the-loop approval workflows.
- Backend & Pipeline Coverage: Build API, contract, and integration testing for Python microservices and Kafka event pipelines , including replay and failure-injection scenarios.
- CI/CD Quality Enforcement: Integrate all test suites into CI as enforced quality gates with strict thresholds rather than advisory reports.
- Suite Health & Root-Cause Triage: Monitor execution time, flake rate, and critical path coverage; perform root-cause analysis to permanently fix test flakiness rather than relying on simple retries.
- AI & Agentic Evaluation: Build evaluation suites for agentic AI workflows (validating tool selection, arguments, escalation behavior, and operating envelope limits).
- Non-Deterministic Testing: Define regression testing for non-deterministic components, including golden-set evaluations, tolerance thresholds, and drift detection post-prompt/model changes.
- Edge & Boundary Verification: Automate test suites for edge deployments (offline/reconnection scenarios) and verify human-in-the-loop security boundaries under adversarial conditions.
- Process & Mentorship: Convert operational SOPs and incomplete specs into executable acceptance criteria alongside Technical Business Analysts, and coach engineers on test ownership.
Must-Have Skills
- Experience Level: 5+ years of hands-on experience owning test automation for distributed systems.
- Core Automation Stack: Deep production experience with Playwright (fixtures, parallelization, trace analysis, CI integration) and strong proficiency in both Python and TypeScript .
- Backend & Messaging: Proven experience in API, contract, and integration testing, service virtualization/mocking, and event-driven architectures like Kafka .
- CI/CD & Infrastructure: Practical experience setting up CI quality gates in GitHub Actions or Azure DevOps , with basic Kubernetes literacy for containerized testing environments.
- AI & Problem-Solving: Hands-on experience with AI-assisted testing methodologies, critical judgment of AI-generated code/tests, and strong root-cause debugging skills.
- English Proficiency: Fluent English for daily written and verbal communication.
Nice-to-Have Skills
- AI Agents & Automation: Experience with Playwright MCP, AI coding agents running non-interactively in CI, or the Claude Agent SDK .
- LLM Product Testing: Prior experience testing LLM or agent-based products in production, non-deterministic systems, or building MCP servers for test observability.
- Resilience & Security Testing: Experience with performance/load testing for high-volume telemetry, chaos/fault-injection, or security testing in CI (dependency scanning/dynamic analysis).
- Domain Knowledge: Background in energy systems, smart grid technology, industrial operations, or data center environments.
Time Zone & Collaboration
The role requires collaboration with teams aligned to Central Time (CT). Flexibility to overlap with North America business hours is expected.
Language
All interviews, documentation, and daily communication will be in English.
#LI
Vacante publicada el 9 días atrás
Empleos similares que podrían interesarleBasado en la vacante 2013/2014 Sr QA Automation Engineer - AI First en Teletrabajo
- ...• Able to organize competing priorities logically and review outstanding contractual risk and issues • Able to effectively use automated systems and computerized applications • Ability to demonstrate a customer focused style of communication, problem solving and collaboration...Trabajo remoto
- ...• Able to organize competing priorities logically and review outstanding contractual risk and issues • Able to effectively use automated systems and computerized applications • Ability to demonstrate a customer focused style of communication, problem solving and collaboration...Trabajo remoto
- ...needed to enjoy the game. For more information, visit xsolla.com . ABOUT YOU We are looking for a Middle/Senior Backend Engineer who is passionate about building scalable blockchain infrastructure and Web3 services to join our Xsolla ZK team . The best...
1.000 AR$ por año
...Anywhere Jobs (FlexJobs, 2025). We are looking for Senior CV Engineer . Your main tasks will be: Train and fine-tune... ...kernel and framework-level work Optionally: train multimodal AI companions that combine CV and NLP for deeper visual understanding...- ...lenders and investors with smarter pricing, automated eligibility, and end-to-end transaction... ..., down to the pricing and eligibility engines that decide what a loan is worth and who... ...Requirements: ~ Daily, hands-on work with AI coding agents – Cursor, Claude Code, Codex...
1.000 AR$ por año
...specifications together with AI agents, and take full responsibility... ...team and help evolve our AI-first development process We expect from you: Senior-level engineering background with experience... ...deployment and integrations (backend engineer or software architect) AI...- ...Specialist to be the hands-on technical presence in our Buenos Aires office. You'll be the first line of support for employees, resolving tickets through our help desk using state of the art, AI powered support tooling, while also owning the technology that makes our office run...
- ...accountants manage the books for startups and small businesses across the US. We're growing fast, and we're looking for a Senior Full Stack Engineer to accelerate our product and help our customers better serve their small business clients. OUR TEAM notion. site/About-our-team-...
- ...confidence. YOUR MISSION As a Senior Software Engineer on the Admin & IAM team, you will design... ...with a small, focused team in a remote-first environment, with the option to work from... ...quality, performance, and reliability - Use AI tools as a part of your fundamental...
- ...00–$15. 00) Help build more natural voice AI by recording short, one-sided phone calls in... ...metadata after each call. Pay: $1. 50 per QA-approved session You need at least 4 approved... ...market. Please Note This project follows a first-come, first-served approach and operates...
- ...Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science... ...information, visit blend360. com We’re looking for a Lead Data Engineer with strong experience designing, developing, and maintaining...
- ...Who We Are: Power Digital is an AI-Native Growth Firm built at the intersection of world-class talent and proprietary technology. We... ...creativity, and accountability remain central to how we work. As a people-first firm, we value diversity in backgrounds and experiences. We...
- ...," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get... ...datasets, flagging opportunities for automation and escalating policy questions to designated... ...customer metrics. - Utilizes generative AI responsibly, maintaining human oversight...
- ...including data integration, data science, visualization, Big Data, AI, and Generative AI. - Cloud & Application Services: We integrate... ...is not required; however, basic knowledge of Python and automation concepts will be considered a plus. Key Responsibilities - Monitor...
- ...craft or quality. We’re looking for a Senior Software Engineer to build and evolve Webflow Cloud, helping builders... ...web applications with the assistance of cloud based AI agents. ABOUT THE ROLE: - Location: Remote-first (Argentina) - Permanent, full-time employee (this is...
- ...applications and next steps. Our partner is looking for a Product Engineer (AI-Native) based in Argentina. Own product features end-to-end,... ...remote, international team and help continuously evolve an AI-first engineering process. This is an opportunity for an...
- ...including data integration, data science, visualization, Big Data, AI, and Generative AI. - Cloud & Application Services: We... ...deliver high-quality solutions and business value. - Follow software engineering and data development best practices to ensure robust,...
- ...implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI. - Cloud & Application Services: We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS,...
- ...implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI. - Cloud & Application Services: We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS,...
- ...Designer to define and elevate the visual identity of a fast-growing B2B SaaS business operating at the forefront of AI search optimization. As the first dedicated designer, you will have significant ownership over how the brand appears across websites, sales materials,...
- ...implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI. - Cloud & Application Services: We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS,...
- ...Blend is a premier AI services provider, committed to co-creating meaningful impact... ...blend360. com We are seeking an Lead AI Engineer to contribute to our next level of growth... ...rapid iteration and reliable deployment - Automate the full MLOps/LLMOps lifecycle: tracking...
- ...commerce storefronts. This is a hands-on engineering role for someone who can work across the... ..., custom applications, integrations, automations, and third-party commerce infrastructure... ..., and implement durable fixes. Use AI-powered development tools to accelerate...
- Thermo Fisher Scientific seeks a Senior Clinical Data Team Lead or Clinical Data Team Lead to lead data management activities for clinical trials. The role involves overseeing complex studies, managing cross-functional liaisons, mentoring staff, and ensuring compliance...
- Thermo Fisher Scientific seeks a Senior Clinical Research Associate to monitor investigational sites, ensure protocol compliance, and manage clinical trial documentation. The role involves remote and on-site visits across multiple studies, coordinating with sponsors and...
- ...As an Engineering Manager on Coder’s Core Workspaces team, you’ll lead... ...is the leading platform for AI development Infrastructure, enabling... ...which applications to review first. – Granola takes notes... ...audit has been conducted on “Automated Employment Decision Tools”;...
- ...Circle is building the world’s leading AI-powered, all-in-one platform for digital... ...ROLE We’re looking for a Senior Quality Engineer to help shape how quality is built into our... ...product thinking, exploratory testing, automation and technical investigation to help teams...
- ...protection company and remote-first team of 300+ on a mission to raise... ...in 2008 and profitable since 2014, annual revenue now exceeds $100m... ...iOS and Android our search engine and the DuckDuckGo subscription... ...private, useful, and optional AI, including Duck.ai which lets...
- ...BUILDING Mimica is an AI-powered process... ...remove process bottlenecks, automate the right tasks, and upskill... ...people, remote-first and globally distributed... ...person team of Senior+ engineers and Product leaders who... ...building out the automation engine, as one of its founding...
- ...ABOUT ELEVENLABS ElevenLabs is an AI research and product company transforming how... ...We launched in January 2023 with the first human-like AI voice model. Today, we serve... ...work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders...
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a 2013/2014 Sr QA Automation Engineer - AI First. ¡Sea el primero en aplicar!
