About the Role
We're looking for a full-time Senior QA Engineer to own product quality across our frontend, backend, and LLM-powered agents.
You'll work closely with our engineering, AI, and product teams to define quality standards and improve how the team validates and ships software.
Key Responsibilities
- Design and automate test strategies across frontend, backend APIs, and end-to-end product workflows
- Evaluate LLM agents for correctness, reliability, consistency, safety, latency, cost, prompt-injection resistance, tool and retrieval behavior, fallback and failure handling, and regressions introduced by changes to models, prompts, tools, or retrieval systems.
- Build and maintain evaluation datasets, test cases, and automated evaluation pipelines for LLM-powered features
- Build automated evaluation workflows to validate the correctness, completeness, breadth, and depth of AI-generated content based on human feedback
- Use LLM tools to improve test generation, bug investigation, and regression workflows
- Collaborate with engineering, AI, and product teams to reproduce issues, define expected behavior, and verify fixes
- Own and drive the overall QA strategy by partnering with customers, product, and engineering teams to understand quality expectations, translate feedback into measurable standards and acceptance criteria, establish release quality gates, and build scalable quality practices across the organization.
Must-Have Qualifications
- 5+ years of experience in software QA, quality engineering, software testing, or a related engineering role
- Strong experience testing web applications, backend APIs, and end-to-end workflows
- Hands-on experience testing LLM-powered applications, AI agents, or RAG systems, including retrieval quality, source grounding, citation accuracy, tool usage, multi-step workflows, and nondeterministic failures
- Experience designing LLM evaluation criteria and building evaluation datasets or automated evaluation pipelines
- Proficiency in Python and TypeScript/JavaScript for test automation, evaluation pipelines, and tooling development
- Hands-on experience with testing frameworks such as Playwright, Cypress, Selenium, pytest, or similar tools
- Strong debugging skills across frontend, backend, and AI components
- Experience using AI coding or LLM tools to improve daily QA workflows
Preferred Qualifications
- Experience communicating with customers and translating ambiguous feedback into reproducible bug reports, test cases, or acceptance criteria
- Familiarity with Python, JavaScript, TypeScript, SQL, REST APIs, WebSocket, or SSE
- Experience with observability tooling and production debugging
- Domain knowledge in semiconductors, hardware, or AI hyperscaler sectors
- Experience working at a startup or in a fast-moving product team
Compensation
Compensation for this role emphasizes long-term upside and meaningful ownership. We offer a combination of salary and equity—structured to reflect your experience, ownership mindset, and the impact you'll have on the company.
This is a role for someone who wants to build, not just operate. You'll be rewarded as a true contributor to the company's growth, with equity that aligns your success directly with Deeli AI's long-term value creation.
Why Join Us
- Define how enterprise product decisions are made—grounded in real customer data and usage insight, not guesswork
- High ownership: As our first full-time AI-native QA engineer, your decisions will influence how global enterprises discover, evaluate, and act on emerging technologies
- Meaningful upside: Join early with meaningful ownership and long-term upside
- Collaborate with a globally distributed, top-tier talents across the Bay Area(US), New York(US), Taiwan and Europe(Germany)
About Deeli AI
In an era of data explosion and AI breakthroughs, innovation decisions are still made based on fragmented signals and gut instinct. Every year, global R&D focused enterprises spend billions exploring new technologies—yet they often miss key opportunities or bet on the wrong ones.
This isn't just an efficiency problem. It's a massive waste of innovation potential.
At Deeli AI, we're solving this challenge by building the world's first AI-native innovation intelligence platform. Our mission is to empower every innovation-driven organization to make confident, data-backed decisions—at the right time, with the right signals. We aggregate global deep tech signals—academic research, patents, grants, and stealth startups—to surface emerging technologies before the market reacts.
Founded by a second-time entrepreneur and built by a world-class team with experience at MediaTek, AWS, and Deloitte, we're backed by the Berkeley SkyDeck Fund in Silicon Valley, ITIC (a deep tech fund in Taiwan), and NVIDIA Inception. We're already collaborating with multiple top semiconductor companies worldwide, with pilots valued in the hundreds of thousands of dollars.
This is the perfect time to join us—at an inflection point where your contribution will directly shape both our product and the future of innovation intelligence.
