Engineering

QA Engineer (Automation and AI Evaluation)

  • Remote (India)
  • Full time
  • 2+ years

You make sure what we ship works: automated tests for web and mobile apps, and evaluation of AI features so quality is measured, not guessed.

What you will do

  • Plan and automate tests for web apps, mobile apps and APIs
  • Build and run evaluation sets for LLM and agent features (QA and AI evaluation)
  • Track accuracy, regressions and edge cases release by release
  • Add tests to CI so every change is checked before it ships
  • Report issues clearly and work with engineers on fixes

What you bring

  • 2+ years in QA with test automation
  • Playwright, Cypress, Selenium or Appium
  • API testing (Postman or code-based)
  • Basic Python or JavaScript
  • Clear written English for working with remote teams and clients

Good to have

  • Testing LLM or chatbot features
  • Performance or security testing
  • ISTQB or a similar certification

How we work

Remote, from anywhere in India, 9 am to 6 pm IST. You work in a small team with a lead engineer, ship in short cycles and review each other's code. Projects come from clients in India and around the world.

Apply

Apply for this role

Send your CV and a few lines about you. The form goes straight to the KaliIO team.

    Careers

    Other open roles