Sr/Lead Developer PySpark and GCF

Vollzeit Kein Home Office möglich

At Innovon Technologies, we are a reputable technology services and consulting firm with a global reach. We specialize in providing high-quality services that deliver impactful results to our clients. Our mission is to empower businesses to achieve more by leveraging the latest technological advancements and best practices in their industries.

Job Role: PYSPARK with GCP

Responsibilities:

At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL, capable of configuring data pipelines.
At least 2 years of experience in Cloudera Data Platform (CDP).
Skills and experience to support the upgrade from Hadoop to Cloudera.
Good knowledge of Industry Best Practice for ETL Design, Principles, Concepts.
Possess the following technical skills – SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar).
Data Extraction from Teradata, HIVE, Oracle, and Flat files.
Ability to work independently on specialized assignments within the context of project deliverables.
Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines.
Proven problem-solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge.
Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills – the ability to communicate efficiently at a global level is paramount.
Ability to deliver materials of the highest quality to management against tight deadlines.
Ability to work effectively under pressure with competing and rapidly changing priorities.
Excellent communication skills & team player.