Tillbaka till jobb

Data Engineer

Data & AIMid-level
Malmö, SwedenContract · On-site Publicerad 2 november 2026 Ansök senast 6 november 2026
Språk: SweMinsta erfarenhet: 5 år

Liam Tran

HR Administrator

cv@veritaz.se

Efterfrågade kompetenser

KubernetesAWSSQLpythonTerraformApache AirflowApache KafkaApache Spark

Om tjänsten

Role Summary

Our client is seeking an experienced Data Engineer for a hands-on consulting assignment focused on software and data engineering in AWS. The role covers the full engineering lifecycle, taking data pipelines and supporting services through design, development, automated testing, deployment, and secure production operation. These capabilities will provide dependable data to business applications, operational processes, reporting solutions, and AI workloads.

You will work in a cross-functional engineering team, contributing both to shared platform capabilities and to data products and pipelines for specific sources. Production-quality code, infrastructure automation, scalability, security, and service reliability are central to the assignment. This is an engineering position rather than a Data Analyst role; dashboard creation and ad hoc analysis are not its primary responsibilities.

Key Responsibilities

  • Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in AWS.
  • Build pipelines using Python and Apache Spark, integrate external and internal APIs, and implement Kafka-based data ingestion.
  • Create reusable components for data ingestion, workflow orchestration, and shared platform services.
  • Provision and manage AWS resources through infrastructure as code, preferably using Terraform.
  • Develop unit, integration, and data-contract tests, as well as reconciliation checks and data validation controls.
  • Monitor pipelines and cloud infrastructure, investigate production incidents, maintain alerts and recovery procedures, and implement measures that prevent recurring failures.
  • Implement access controls, encryption, and secrets management to support secure operation.
  • Identify performance constraints and optimize pipeline execution, infrastructure utilization, and cloud expenditure.
  • Contribute to technical design decisions, delivery estimates, legacy migration activities, and controlled production deployments.
  • Maintain technical documentation, share engineering knowledge, communicate design rationale, and proactively identify delivery risks and technical issues.
  • Use approved AI-assisted development tools to support implementation, testing, and documentation while ensuring that generated code is appropriately reviewed and tested.
  • Deliver reliable pipelines that provide data on schedule, recover effectively from failures, reduce recurring incidents, and meet agreed commitments.

Technical Stack & Requirements

  • Programming and querying: Strong hands-on Python development and SQL experience, including work with data structures, schemas, file formats, and data models.
  • Data processing: Production experience with Apache Spark and the development of both batch and streaming data pipelines.
  • Streaming and integration: Kafka-based ingestion and integration with APIs.
  • Workflow orchestration: Experience with orchestration tools such as Apache Airflow.
  • Cloud platform: Practical AWS experience, particularly with Amazon S3, IAM, encryption, logging, and networking.
  • Infrastructure as code: Experience provisioning cloud infrastructure through Terraform or comparable infrastructure-as-code practices.
  • Containers: Experience operating containerized workloads with Kubernetes, including Amazon EKS.
  • Engineering workflows: Experience with Git, code review, automated testing, and CI/CD practices.
  • Production operations: Knowledge of data quality, monitoring, observability, production support, incident diagnosis, recovery, and maintainable service operation.
  • Advantageous technologies: Experience with dbt and modern data-transformation practices is beneficial.

Qualifications & Experience

A degree in Computer Science, Engineering, or a related discipline is required, although equivalent practical experience is acceptable. The successful consultant will have strong practical experience in cloud-based data engineering and software development, with a demonstrated record of creating, deploying, and maintaining production-grade data pipelines or data-platform services. Strong hands-on expertise in both Python and AWS is essential.

The role requires the ability to diagnose complex technical problems, explain the reasoning behind engineering decisions, and collaborate effectively with developers, architects, and other stakeholders. Experience in banking or another regulated industry, relevant AWS certifications, legacy-data migration, and dbt-based transformation are considered advantageous.

Work Logistics & Location

This is a consulting assignment within a cross-functional engineering environment. The work location, remote-working arrangement, assignment duration, and expected on-site presence are not specified. Professional fluency in English is required.

Intresserad av denna tjänst?

Skicka din ansökan så återkommer vi inom kort.

Ansök nu