QA Automation Engineer

Shoplift is a NYC-based SaaS startup that provides an intelligent, automated experimentation and personalization platform to optimize online storefronts for e-commerce merchants such as Kith, Liquid Death, and Olukai.

• 4+ years of QA experience with a strong focus on test automation
• Proficiency with modern test automation frameworks such as Playwright, Cypress, or Selenium
• Experience writing automated tests in JavaScript/TypeScript or similar languages
• Experience integrating automated tests into CI/CD pipelines like GitHub Actions or CircleCI
• Strong understanding of e-commerce concepts (orders, checkout, cart, conversions, subscriptions)
• Experience with API testing and automation tools like Postman or REST Assured
• Proficiency with browser developer tools for debugging and network inspection
• Ability to balance automation work with hands-on exploratory testing
• Strong communication skills and ability to work autonomously in a small team
• Attention to detail and critical thinking about edge cases
• Experience with manual testing methodologies and test case design
• Strong understanding of responsive design and cross-browser testing
• Comfort balancing manual testing workload with automation development

Nice to have:

• Familiarity with the Shopify ecosystem (apps, themes, admin) or similar e-commerce platforms
• Experience with A/B testing or experimentation platforms
• Understanding of statistical concepts such as significance, confidence intervals, and Bayesian statistics
• Familiarity with Vue.js frontend applications and component-based architectures
• Experience with .NET/C# backends and full-stack data flow
• Experience with PostgreSQL or similar relational databases for data validation
• Knowledge of GraphQL APIs and Shopify's Admin API
• Background in conversion rate optimization (CRO) or growth experimentation
• Experience building test frameworks or infrastructure from scratch
• Experience with visual regression testing tools such as Percy or Chromatic

• Perform thorough manual QA on new features across browsers, devices, and Shopify themes
• Design, build, and maintain automated test suites covering critical user flows for various experiment types
• Integrate automated tests into the CI/CD pipeline to run on every pull request and deploy
• Own regression runs, analyze failures, triage flaky tests, and report bugs caught by automation
• Own pre-release testing to ensure existing functionality remains intact
• Test on live Shopify storefronts across multiple themes and viewports manually and via automation
• Validate Shopify Admin API integrations, billing flows, subscription management, and third-party integrations such as Google Analytics and Segment
• Verify statistical calculations, reporting accuracy, and real-time order attribution across analytics dashboards
• Conduct exploratory testing to identify edge cases and usability issues
• Document and reproduce bugs with clear detailed steps and verify fixes
• Collaborate with developers to improve testability, validate fixes, and provide input during feature development