[Agent Tools](https://tools.openkrill.app/) / [Blog](https://tools.openkrill.app/blog)

# Search the Job Title, Not the Posting: Vercel "engineer" Went From Precision 0.40 to 1.00

We searched "engineer" on Vercel's job board through our own tool and got sales roles first. Meanwhile, 26 of the 36 real engineer jobs were cut off.

By OpenKrill. Published 2026-11-04. Based on our own truth cases of 2026-10-21 and a live check of 2026-11-04.

The cause was how the search matched. A word found anywhere in a posting counted as a hit, so a sales role that says "you will work with engineers" looked like an engineer job.

## How we measured it

On 2026-10-21 we built 10 truth cases from the official job boards of real companies on Greenhouse, Ashby and Lever. For each company and role word, the truth is the exact list of jobs whose title names that role. We wrote the rule for "the title names the role" before we changed any code. Then we scored the live tool before the fix and the fixed code after it, against the same live boards. These are our own measurements.

| Measure | Before | After |
| --- | --- | --- |
| Truth cases that pass | 0 of 10 | 10 of 10 |
| Vercel "engineer": jobs shown | 25 | 36 |
| Vercel "engineer": precision | 0.40 | 1.00 |
| Vercel "engineer": recall | 0.28 | 1.00 |
| Jobs per company in one answer | 25 | 50 |

The old search matched the word as a substring of the title, the department and the full job text. It then cut the list A to Z at 25. Sales postings that mention "engineers" sorted first, and the real engineer jobs fell off the end.

## What you can do today

When you search any careers page, search the job title, not the whole posting. A phrase like "work with engineers" in a description tells you nothing about the role. To check a result list:

1. Count how many titles on the list name the role. That count divided by the list length is your precision.
2. If the list stops at a round number such as 25, assume jobs were cut off, and narrow the search.
3. Be careful with short words. "intern" should not match "International", and "manager" should not match "Managing Director".

Our rule follows the same steps. The title decides. Plurals and trade words match ("engineering", "recruiting"). Hyphens and spaces are optional, so "front-end", "front end" and "Frontend" all match. Words under 4 letters take only a plural, so "go" does not match "going".

The employer's title decides, so Solutions Engineer, Sales Engineer, GTM Engineer, Forward-Deployed Engineer and Engineering Manager all count as engineer jobs. To leave them out, add words such as "software engineer", or use the department filter.

If you would rather not scroll a careers page that has no role filter, [Company Jobs Finder](https://tools.openkrill.app/tools/company-jobs) filters by role on the job title across up to 5 company boards in one call. It also tells you when a match came only from the posting text.

## A live check, and what still misses

On 2026-11-04 we asked the deployed tool for "engineer" at Vercel with limit 50. It returned 31 jobs. Under a minute later Vercel's public [Greenhouse board](https://job-boards.greenhouse.io/vercel) listed 88 jobs, and 31 of them had "engineer" or "engineering" in the title. The tool's 31 titles were exactly those 31. The engineer count moves: 35 at the audit, 36 at the fix run, 31 on 2026-11-04.

The gaps we know about:

- The live check on the deployed tool covered 1 of the 10 cases, Vercel "engineer". The other 9 were scored on the fixed code against the live boards, not on the deployed tool.
- The truth set covers Greenhouse, Ashby and Lever only. Workable and SmartRecruiters boards are not in it.
- A role named only in the department, such as "Sales" for an Account Executive, needs the department filter, because the rule reads only titles.
- "go" still matches "Go-To-Market" titles, and "site reliability engineer" misses a bare "SRE" title.

## Frequently asked questions

### What does one call return for "engineer" at Vercel?

On 2026-11-04, one call with limit 50 returned 31 jobs, each with "engineer" or "engineering" in the title. That matched the 31 such titles on a board of 88 jobs, at precision 1.00 and recall 1.00.

### What happens when the word is a skill, such as "rust"?

Only when no title on the whole board names the word does the tool read the job text, as whole words. The answer then says the results may be other roles. If a title exists but another filter drops it, such as a location filter that rules out every engineer job, the answer stays empty.

### Why did the per-company cap rise to 50?

A role with 36 openings did not fit under the old cap of 25. At 50, the whole Vercel engineer list fits in one answer.

## Sources

- Based on our own truth cases of 2026-10-21 and a live check of 2026-11-04.
- [Vercel's public Greenhouse board](https://job-boards.greenhouse.io/vercel), read 2026-11-04.
