The work
You join a client team in financial services that runs data and machine learning in production. You build the pipelines that feed the models, keep them healthy, and make sure every re-run is safe.
- Design, build and run batch and streaming pipelines with Spark
- Bring ML models into production and handle their inputs, outputs and data changes
- Watch the platform through logs, metrics and alerts, and fix what needs fixing
- Shape CI/CD for data and ML workloads on Azure
- Validate data, profile performance and keep processing idempotent
- Work closely with backend, platform and business teams, and document as you go
What you bring
- 7 or more years in software or data engineering, a good part of it on production data or AI systems
- Production Python and SQL
- Spark or PySpark
- Azure data services: Databricks, Synapse, Data Lake and Azure DevOps
- Hands-on incident and support experience, structured and calm when something breaks
- Fluent English, written and spoken
- The right to work in the EU
Nice to have
- MLflow or Weights & Biases
- Experience in banking or another regulated industry
How we work
Remote first, with time on site in Lisbon when the work needs it. You work inside the client’s team and tools, with a clear scope and a clean handover.