Assignment Description:
We are looking for a Senior Data Engineer to join our dynamic team.
What you will work on:
- Build and maintain large-scale data infrastructure to support machine learning projects, with a focus on scalability, performance, and maintainability.
- Implement end-to-end data solutions, including designing, developing, and optimizing data pipelines to process vast amounts of structured and unstructured data.
- Use data query languages like SQL and BigQuery and work with various data formats such as Parquet and Avro to manage and query data efficiently.
- Apply DevOps principles to manage CI/CD pipelines, using tools such as Terraform to ensure a seamless cloud infrastructure on Google Cloud Platform (GCP).
- Collaborate with cross-functional teams of engineers, data scientists, and business stakeholders in an agile environment to drive data product innovation.
- Leverage your knowledge of software architecture and design patterns to write high-quality, future-proof code that ensures long-term success.
What you bring:
- Proven experience with data query languages (SQL or similar) and data formats (Parquet, Avro), with hands-on experience in BigQuery.
- Strong background in designing and maintaining large-scale data infrastructure for machine learning or data-driven projects.
- Experience with cloud platforms, particularly Google Cloud Platform (GCP), and infrastructure-as-code tools like Terraform.
- A DevOps mindset, with experience in managing CI/CD pipelines and automating cloud infrastructure.
- Knowledge of software architecture and design patterns, with a track record of writing scalable, maintainable code.
- Experience working in agile, cross-functional teams, collaborating closely with data scientists, engineers, and business stakeholders.
- Passion for data and a commitment to ensuring data quality, availability, and usability across the organization.
If this sounds interesting, please send your CV to cv@veritaz.se
