Posted 1h ago
Loading this job…
ETL and Data Pipeline Intern (Python)
Posted 2h ago0 views
Something breaks in a data pipeline roughly every week. Learning to work out what, quickly, is the most transferable skill in this field, and it is what this internship is built around.
The stack you will touch
We ingest from Postgres, a payments provider, a mail service webhook and two partner job feeds. Across six months in our Mumbai office you will own partner feed ingestion end to end: scheduled Python jobs that pull XML and CSV drops, validate them against a schema, quarantine bad rows rather than silently dropping them, and load into the warehouse with idempotent upserts.
What good looks like
A pipeline nobody has to think about. That means retries, an alert into Slack when a feed lands late, and a runbook written for whoever is on call, who will not be you. You will also backfill three years of partner history, which is where you will learn exactly why timezone handling matters.
Learning support
Your mentor is the engineer who built the original ingestion layer. You get code review on every pull request and a fortnightly deep dive on one topic you choose, whether that is indexing, orchestration or testing data. Freshers welcome, provided you write Python that reads clearly and are not scared of a stack trace.
Responsibilities
- Own ingestion for two partner job feeds arriving as scheduled XML and CSV drops
- Validate incoming files against a schema and quarantine bad rows instead of dropping them
- Load records with idempotent upserts so a rerun never creates duplicates
- Add retries and Slack alerting for late or failed feed landings
- Backfill three years of historical partner data, timezone handling included
- Write a runbook somebody other than you can follow at short notice
- Respond to code review and keep pull requests small enough to review properly
Requirements
- Final year student or recent graduate who writes readable Python
- Basic SQL and a clear idea of what a primary key is for
- Not put off by reading a stack trace or a log file
- Able to work hybrid from our Mumbai office
- Committed to the full six month duration
Skills
Benefits
- Mentored by the engineer who built our original ingestion layer
- Fortnightly deep dive session on a topic you pick
- Certificate and a reference letter on completion
- A realistic path into a junior data engineering role with us