Assignment Description:
We are looking for a Senior Data Engineer to join our dynamic team.
What you will work on:
- Collaborate with Data Scientists, ML Engineers, Data Analysts, and Data Engineers to drive the transition into a data-driven culture where Data, Analytics & AI/ML are embedded in services and processes.
- Take responsibility for the entire journey from raw data to actionable insights, generating value from 1.6 million connected assets.
- Support the final stages of migrating the AWS native data lake solution to Databricks.
- Contribute to setting standards for Machine Learning Engineering on the new Databricks platform.
- Identify and implement architectural patterns that integrate into the microservice architecture.
- Build, optimize, and maintain high-performance data pipelines and production-ready ML solutions.
- Act as a senior team member, coaching and supporting colleagues while introducing state-of-the-art practices in data and ML engineering.
What you bring:
- Proven expertise with Databricks, including:
- Data Engineering tools (Lakeflow, Lakeflow Declarative Pipelines, Unity Catalog)
- ML Engineering tools (MLflow, Model Training, Model Serving, Agent Bricks, AI Gateway & Agent Framework, Evaluation)
- General knowledge of Unity Catalog and AWS basics
- Strong programming skills in Python, PySpark, and Bash.
- Solid experience with GitHub and CI/CD, delivering high-quality, maintainable code.
- Strong knowledge of architectural patterns in Machine Learning Engineering and Data Engineering.
- Excellent collaboration and communication skills, with the ability to work effectively in cross-functional teams.
- Ability to adapt quickly, bring innovative ideas, and mentor others.
If this sounds interesting, please send your CV to cv@veritaz.se
