Assignment Description:
We are looking for a Senior Data Engineer to join our dynamic team.
What you will work on:
- Design, build, and optimize robust data pipelines (ETL/ELT) integrating multiple structured and unstructured data sources.
- Develop and maintain data models, ensuring high availability, scalability, and reliability of data infrastructure.
- Work with Databricks, Unity Catalog, Apache Spark, and Delta Lake to support advanced analytics and data lakehouse solutions.
- Collaborate closely with data scientists, software engineers, and project managers to deliver efficient and high-quality data integration solutions.
- Implement CI/CD pipelines, version control (Git), and DevOps practices for automated and reliable data workflows.
- Ensure adherence to best practices in data quality, governance, and security.
- Leverage Azure cloud services such as Azure Data Lake and Azure Data Factory to manage, process, and distribute data efficiently.
- Monitor and optimize cloud resource usage for performance and cost-effectiveness.
What you bring:
- 5+ years of experience in data engineering or software development.
- Strong proficiency in SQL and Python for data processing and automation.
- Hands-on expertise with Databricks, Unity Catalog, Apache Spark, and Delta Lake.
- Proven experience designing and implementing scalable ETL/ELT pipelines.
- Deep understanding of Azure cloud platforms, data lakehouse architectures, and dimensional modeling.
- Practical experience with CI/CD, version control (Git), and DevOps methodologies.
- Strong understanding of data engineering best practices and ability to promote them across teams.
- Excellent analytical, problem-solving, and troubleshooting skills.
- Strong communication skills and the ability to collaborate effectively across technical and non-technical teams.
- Self-driven, proactive, and able to work independently in a fast-paced environment.
- Nice to have: Experience with Power BI for data visualization and reporting.
If this sounds interesting, please send your CV to cv@veritaz.se
