How a San Francisco SaaS Company Used Technical Interviews as a Service to Hire 11 Engineers in 8 Weeks

Series B SaaS Company, San Francisco · Technology

A Series B SaaS company in San Francisco hired 11 engineers in 8 weeks while reducing senior-engineer screening from 15 hours a week to zero, and raised final-round pass rate from 28% to 71%.

Results at a Glance

  • Senior-engineer screening hours: 15/wk → 0
  • Time to offer: 49 days → 16 days
  • Final-round pass rate: 28% → 71%

Background

Every technical screen cost a senior engineer an hour of focus, and most of those hours were spent on candidates who would not pass. At a 28% final-round pass rate, roughly seven of every ten interviews a senior engineer ran were, in hindsight, unnecessary.

The Challenge

Every technical screen cost a senior engineer an hour, plus prep and writeup. With 4 open backend roles and 300+ applicants, the team faced a choice: burn sprint capacity on interviews or filter hard on resumes and miss great engineers from non-brand companies.

What They Tried First

Before The Cognitive, the team tried tightening recruiter screens and leaning harder on resume signals: brand-name companies, familiar stacks, tidy career paths. It made the queue look cleaner, not better. Engineers still spent focus time validating basics, and the stricter filter risked rejecting strong backend candidates whose experience did not read like the obvious safe pick.

The Solution

The Cognitive ran technical interviews as a service: every applicant got a live AI technical interview - system design and live problem-solving with adaptive follow-ups - within 48 hours of applying. Engineers reviewed evidence-scored shortlists with quotes and timestamps instead of running screens.

How the Rollout Went

Rollout started with agreeing what evidence mattered for backend roles, then routing applicants into live AI technical interviews and sending engineers shortlists with quotes and timestamps. The surprise was how quickly hiring managers shifted from asking whether a resume deserved a screen to debating actual problem-solving evidence. The rough patch was calibration: early scorecards were too verbose, so the team had to tighten what reviewers saw.

The Results

11 engineers hired in 8 weeks. Final-round pass rate more than doubled because humans only met candidates who had already demonstrated ability. Engineering reclaimed 15 hours a week of senior time. For teams asking how to hire software engineers without burning senior capacity, this split - AI runs depth at scale, humans decide - was the unlock.

What It Was Worth

15 senior-engineer hours a week, returned. Over 8 weeks that is 120 hours of senior engineering time — and the final-round pass rate rising to 71% means the interviews they did run were with candidates worth the hour.

What Transfers to Other Teams

Pass rate is the honest measure of whether a screening step works. A rate that low means the filter before it was not filtering; raising it to 71% means the panel now sees candidates who have already demonstrated the skill.

We stopped outsourcing our roadmap to our interview calendar. The AI does the screens; our engineers do the final rounds and the shipping.

VP Engineering, VP Engineering, Series B SaaS

Questions About This Rollout

Do senior engineers still interview?

Yes, in final rounds. What they stopped doing is first-round screening, which is where 15 hours a week was going and where the 28% pass rate was being set.

How is a technical screen assessed without an engineer present?

The interviewer asks role-specific technical questions and probes the reasoning behind each answer, then returns a scorecard where every judgement links to what the candidate actually said, so the engineer reviewing it can check the evidence in seconds.

Other hiring teams we have done this for

All case studies · Book a demo