Senior Software Engineer 5 - Consumer Lifecycle Experiences Platform

The Testing Tools & Infrastructure team within the Consumer Lifecycle Experiences Platform is crucial to the Commerce organization. It provides centralized platforms for distributed test execution, customer test data creation tools, flaky test analytics and management, and GenAI-powered tooling to enable fast, trustworthy pre-production feedback. This global and diverse team supports Commerce Engineering engineers worldwide by building developer-facing infrastructure and tooling that scales to millions of test runs per month.

• Experience working on developer platforms, platform services, or productivity-tooling teams.
• Strong skills in software design, with ability to research and document technical tradeoffs clearly.
• Deep understanding of distributed systems, service design, and automation platforms including CI/CD and test orchestration.
• Hands-on daily experience with GenAI in engineering workflows and shipping LLM-powered systems, preferably for developer users.
• Ability to independently drive complex technical projects from conception to completion.
• Effective communication skills for technical and non-technical stakeholders.
• Experience establishing testing culture including proficiency with test frameworks, code coverage tools, continuous integration systems, and post-deployment verification.

Nice to have:

• Production experience shipping and maintaining code in Java, JavaScript, or Python.
• Designing and implementing metrics data pipelines.
• Experience operating CI systems such as GitHub Actions, Jenkins, CircleCI.
• Guiding infrastructure team roadmaps aligned with product-focused team needs.
• Experience with distributed tracing and analysis tools like Zipkin, Honeycomb, Datadog, Splunk, Elasticsearch APM.
• Advanced log, metric, or error stack trace analysis.
• Collaborative mindset fostering an inclusive environment.
• Ability to self-manage and prioritize in ambiguous settings.
• Experience working with globally distributed teams.

• Design, implement, and operate language-agnostic distributed test execution infrastructure and developer tools.
• Develop and maintain software solutions for accurate and efficient analysis of test runs and distributed tracing.
• Create and maintain tools for framework-agnostic analysis of telemetry data for test runs.
• Develop and integrate synthetic test data generation solutions.
• Integrate internal and vendor-provided distributed test execution infrastructure into engineering workflows focusing on reliability and ease of use.
• Build tools, frameworks, and infrastructure for frontend and backend systems testing including mocking, contract verification, and performance harness.
• Design and operate systems to automatically detect, quarantine, and self-heal flaky tests with GenAI-assisted diagnosis.
• Correlate test coverage data with code changes, runtime execution, and trace data for reporting.
• Define testing strategies collaboratively with cross-functional teams and produce documentation on frameworks and troubleshooting patterns.
• Stay informed about industry trends and emerging technologies, especially GenAI applied to developer platforms.