Senior Data Platform Engineer (f/m/x)

Our client, an established company in the
software industry , operates a modern,
cloud-based data platform
in an AWS environment. To strengthen the team, we are looking for an experienced Senior Data Platform Engineer who is passionate about managing, optimizing, and further developing complex
big data architectures .
Your responsibilities:
Administration, monitoring, and optimization of a
big data platform
in the
AWS Cloud
Management and maintenance of
Cloudera On-Cloud PaaS services
as well as AWS-native technologies such as
Kafka, Flink, NiFi, Iceberg Tables , and
DynamoDB
Deployment and automation of infrastructure in AWS using
Terraform
and
ArgoCD
Execution of
updates, upgrades , and
incident management
for all platform components
Advising data platform developers on selecting suitable services for business use cases
Taking over
3rd-level support , including monitoring, error analysis, and troubleshooting to ensure a highly available system (including
24/7 on-call duty )
Optimization of workloads, e.g.:
Flink job memory management
Impala and Trino query optimization
Evaluation and implementation of
cloud-native services
in accordance with the existing system architecture
Your profile:
Very good knowledge of
Linux
Strong experience with
Hadoop services
such as HDFS, Zookeeper, Yarn, Impala, Spark, and Kafka
Experience with
Terraform
for infrastructure automation
Programming skills in
Spark
and
Python
Practical experience with
on-call duty
and structured troubleshooting
Team-oriented working style and strong team spirit
Nice to have:
Experience with
Kubernetes
Specific knowledge of
Cloudera services
such as HDFS, Zookeeper, Yarn, Impala, Hue, Spark, Kafka, Flink, Knox, Ranger RAZ, Streams Messaging Manager, NiFi, and Kudu
Experience with
rolling restarts
in production environments
What you can look forward to:
Hybrid working model
and flexible working hours
Individual
training and development opportunities
Working with modern
cloud and big data technologies
Meal allowance as well as free drinks and fruit
Health initiatives
and company pension scheme
Team events and professional exchange in engineering communities
Good public transport connections and parking facilities
Support with any required
relocation process
#J-18808-Ljbffr