Posted 1h ago
Loading this job…
Search Relevance Prompt Engineering Intern
Posted 2h ago0 views
A candidate types 'remote python job for freshers' into MailerMen and expects the right ten listings back.
Why prompting belongs in search
Keyword matching gets you halfway. The rest comes from an LLM layer that expands the query, infers intent and reranks the shortlist. Across six months you will own the prompts in that layer: the query rewriter, the intent classifier, and the reranker deciding which listing sits at position one.
Measurement, not vibes
You will not be guessing. We keep click through and application rates per query, and you will learn to read them properly. Expect to build a labelled relevance set of about a thousand query and listing pairs, then use it to compare any prompt change against the live version before it ships.
Life on the team
You will work from the Mumbai office three days a week, sitting with two backend engineers and a data analyst. There is a fortnightly relevance review where the team argues about specific queries and specific results. Turn up with examples and you will do well in that room.
Responsibilities
- Own the query rewriting and intent classification prompts in our search pipeline
- Design reranking prompts that order shortlisted job listings by genuine fit
- Build a labelled relevance set of roughly one thousand query and listing pairs
- Compare prompt variants against live click through and application rates
- Investigate bad queries reported by the support team and fix the underlying cause
- Present findings at the fortnightly relevance review using concrete query examples
- Keep a running log of which prompt version is live in each environment
Requirements
- Final year student or recent graduate; coursework and projects count, industry experience is not required
- Python plus enough SQL to pull your own numbers
- Interest in how search ranking works, even if only from reading about it
- Willing to defend a ranking decision with data in a room of engineers
- Available for three office days a week in Mumbai
Skills
Benefits
- Monthly stipend across the full six month term
- Hybrid schedule with three days in the Mumbai office
- Ownership of a surface every user of the product touches
- Certificate and a detailed written performance reference
- Priority consideration for our open graduate engineering roles