Senior Data Engineer (Python)

About the role

We are seeking a senior engineer to own Python data pipelines for a data‑heavy product. You will work closely with app developers, handling everything from design to production fixes.

Key responsibilities

• Build and run Python batch jobs in the cloud on schedules or app triggers.
• Write and optimise analytical SQL at billion‑row scale, fixing out‑of‑memory issues.
• Analyse data to shape matching logic and models, and integrate with many third‑party platforms.
• Move data safely between analytical and relational databases under heavy concurrent writes and plan multi‑step migrations.
• Manage infrastructure as code, deploy via CI/CD, and maintain monitoring, alerts and reconciliation jobs.
• Track cloud costs across providers and allocate them per customer.
• Build product features on top of LLM APIs.

Required profile

• 5+ years of production Python experience, mainly in data pipelines or backend services.
• Strong SQL skills and hands‑on experience with a large‑scale columnar warehouse (ClickHouse, BigQuery, Snowflake, Redshift).
• Solid cloud experience, preferably AWS, and infrastructure‑as‑code tools (Terraform or similar).
• Experience integrating unreliable third‑party REST APIs.
• Daily use of AI coding tools with the ability to review their output.
• Comfort owning work end‑to‑end, shipping small changes often, and writing clear runbooks.
• Good written and spoken English.

Required skills

• Python
• SQL
• ClickHouse, BigQuery, Snowflake, Redshift
• AWS
• Terraform (or similar IaC)
• REST API integration
• CI/CD pipelines
• Monitoring and alerting tools
• LLM API usage