Emprego híbrido
HíbridoSenior Data Engineer | Real-Time & Streaming
Alongside
Resumo da oferta
Extraído do anúncio e comparado com o nosso índice de ofertas
- Escritório em
- Porto, Porto District, Portugal
- Regime de trabalho
- Híbrido, em parte presencial
- Salário
- Não indicado
- Nível
- Sénior
As suas funções
- Build real-time data products with Apache Flink and Apache Kafka
- Develop and operate streaming and batch pipelines
- Design REST APIs, streaming interfaces, and microservices
- Deploy services on AWS and own production operations
- Review code and designs, and mentor engineers
- Apache Flink
- Apache Kafka
- Java
- Python/PyFlink
- Scala
- Avro
- AWS
- Terraform
- GitLab CI
- GitHub Actions
O que se espera
Competências exigidas
- At least 7 years of professional data engineering experience, including 3 years building and operating production real-time or streaming
- Hands-on production experience with Apache Flink, including DataStream APIs and Flink SQL
- Strong Java skills; Python/PyFlink or Scala experience is also valued
- Experience with Apache Kafka, event-driven architectures, Avro, and Schema Registry
- Experience building REST APIs and microservices with OpenAPI, and strong AWS experience
- Strong SQL and data modelling skills, plus experience with CI/CD and observability tools
É bom saber
- Publicado connosco desde
- 9 de novembro de 2026
- Empresa
- Mais 14 ofertas abertas de Alongside no nosso índice. Destas, 1 são 100 % remotas.
Antes de se candidatar
Estes termos aparecem textualmente no anúncio. Se tem estas competências, devem constar também do seu CV.
- DataStream APIs
- Flink SQL
- event-driven architectures
- Schema Registry
- OpenAPI
- SQL
- automated unit, integration, contract, and load testing
Gerado automaticamente pela Nomado24 a partir do anúncio e do nosso índice. Não é uma declaração da empresa. O anúncio original é o que prevalece.
Descrição da função
Alongside partners with organizations to drive digital transformation and build high-performing tech teams .
We are looking for a Senior Data Engineer to join a project with one of our clients operating in the financial markets industry .
You will design, build, and operate real-time data products on an enterprise data platform, taking ownership from event ingestion and stream processing to the APIs and services used by consumers. This is a hands-on role combining advanced streaming engineering, production ownership, and technical guidance.
Responsabilities:
- Design and deliver end-to-end streaming data products using Apache Flink, Apache Kafka, and event-driven architectures.
- Develop stateful stream-processing applications, including windowing, event-time handling, watermarks, checkpointing, and exactly-once processing guarantees.
- Build and maintain resilient ingestion, transformation, and delivery pipelines for real-time and batch workloads.
- Manage Kafka topics, partitioning, consumer groups, schemas, and schema evolution.
- Design and develop REST APIs, streaming interfaces, and microservices with clear contracts, versioning, authentication, and rate limiting.
- Deploy and operate services on AWS, using Infrastructure as Code with Terraform.
- Embed data quality controls, automated testing, observability, and actionable alerting throughout the delivery lifecycle.
- Build and improve CI/CD pipelines, including automated deployment, rollback, and safe release practices.
- Monitor production services against agreed SLAs, investigate incidents, and optimise latency, throughput, reliability, and cost.
- Apply security best practices across authentication, authorisation, encryption, secrets management, and least-privilege access.
- Translate business requirements into technical designs, challenge assumptions, and propose practical solutions.
- Review code and designs, mentor engineers, and contribute to engineering standards and technical documentation.
Requirements
- 7+ years of professional experience in data engineering, including at least 3 years building and operating real-time or streaming systems in production.
- Strong hands-on experience with Apache Flink in production, including DataStream APIs and Flink SQL.
- Strong Java skills, with experience in Python/PyFlink or Scala also valued.
- Solid experience with Apache Kafka, event-driven architectures, and schema management using Avro and Schema Registry.
- Proven experience building APIs and microservices using REST and OpenAPI.
- Strong AWS experience, including relevant services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, and IAM.
- Strong SQL and data modelling skills across streaming and batch workloads.
- Experience with CI/CD tooling such as GitLab CI or GitHub Actions, alongside automated unit, integration, contract, and load testing.
- Experience with observability tools such as CloudWatch, OpenTelemetry, Prometheus, and Grafana.
- Fluency in English, both written and spoken.
Benefits
- The opportunity to build production-grade real-time data products within the financial markets industry.
- End-to-end ownership across streaming pipelines, APIs, and production operations.
- Collaboration with platform engineers, product owners, and business stakeholders.
- Scope to influence technical decisions, improve engineering practices, and mentor other engineers.
- Hybrid working model in Porto.
Esta oferta provém de uma fonte externa. A candidatura é feita no site da fonte.
