Senior Data Platform Engineer (f/m/x)

Our client, an established company in the

software industry , operates a modern,

cloud-based data platform

in an AWS environment. To strengthen the team, we are looking for an experienced Senior Data Platform Engineer who is passionate about managing, optimizing, and further developing complex

big data architectures .

Your responsibilities:

Administration, monitoring, and optimization of a

big data platform

in the

AWS Cloud

Management and maintenance of

Cloudera On-Cloud PaaS services

as well as AWS-native technologies such as

Kafka, Flink, NiFi, Iceberg Tables , and

DynamoDB

Deployment and automation of infrastructure in AWS using

Terraform

and

ArgoCD

Execution of

updates, upgrades , and

incident management

for all platform components

Advising data platform developers on selecting suitable services for business use cases

Taking over

3rd-level support , including monitoring, error analysis, and troubleshooting to ensure a highly available system (including

24/7 on-call duty )

Optimization of workloads, e.g.:

Flink job memory management

Impala and Trino query optimization

Evaluation and implementation of

cloud-native services

in accordance with the existing system architecture

Your profile:

Very good knowledge of

Linux

Strong experience with

Hadoop services

such as HDFS, Zookeeper, Yarn, Impala, Spark, and Kafka

Experience with

Terraform

for infrastructure automation

Programming skills in

Spark

and

Python

Practical experience with

on-call duty

and structured troubleshooting

Team-oriented working style and strong team spirit

Nice to have:

Experience with

Kubernetes

Specific knowledge of

Cloudera services

such as HDFS, Zookeeper, Yarn, Impala, Hue, Spark, Kafka, Flink, Knox, Ranger RAZ, Streams Messaging Manager, NiFi, and Kudu

Experience with

rolling restarts

in production environments

What you can look forward to:

Hybrid working model

and flexible working hours

Individual

training and development opportunities

Working with modern

cloud and big data technologies

Meal allowance as well as free drinks and fruit

Health initiatives

and company pension scheme

Team events and professional exchange in engineering communities

Good public transport connections and parking facilities

Support with any required

relocation process

#J-18808-Ljbffr