Assignment Description:

We are looking for a Senior Data Engineer to join our dynamic team.

What you will work on:

• Design, develop, and maintain scalable batch and stream data pipelines to ingest data from various sources.
• Automate and orchestrate data pipelines using appropriate tools.
• Develop and implement data processing workflows, including cleansing, deduplication, and transformation processes.
• Operate and maintain the data platform in collaboration with the infrastructure team.
• Perform data platform upgrade testing, including regression, security, and functional tests.
• Implement checks and measures to ensure the security, accuracy, completeness, and consistency of data.
• Set up monitoring tools for pipeline performance, data quality, and system health.
• Diagnose and resolve issues with data pipelines, storage systems, or integrations.
• Collaborate with stakeholders to define data models and ensure data meets their needs.
• Provide technical guidance and data access support to data consumers.
• Document data pipelines, architectures, and workflows for clarity and ease of maintenance.
• Design and maintain data models for reporting and analytics in BI tools.
• Develop simple dashboards using Power BI.

What you bring:

• B.Sc. or M.Sc. in Computer Science, Engineering, Information Technology, or equivalent work experience.
• Strong knowledge of data warehousing concepts, ETL processes, DevOps, CI/CD, and software testing.
• Expertise in SQL or Python programming languages.
• Experience with AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. Databricks experience is a plus.
• Proficiency with data processing frameworks like Flink or Spark.
• Experience using Power BI for data analytics and visualization.
• Experience managing data platforms with Infrastructure as Code (IaC) is a merit.
• Interest in big data technologies and eagerness to learn new technologies.
• Excellent communication skills and the ability to drive an independent product stream within a broader team project.
• Ability to navigate ambiguous and evolving situations and proactively manage multiple tasks.
• Fluent in English; proficiency in Chinese is a plus.

If this sounds interesting, please send your CV to cv@veritaz.se