Senior Scala/Hadoop Developer

Added: May 14, 2021
  • Country: Australia
  • Region: New South Wales



Senior Scala/Hadoop Developer

8-10 years? experience





Job Title: Senior Backend Hadoop Developer

REQUIRED Experience: Heavy Scala experience, P360, hadoop, spark,
python, impala, hive,

Interview process: 2 rounds



Job Details:

Develop end to end data pipeline using Spark, Hive and Impala

Write SPARK jobs to fetch large data volumes from source

Understand business needs, analyze functional specifications and map those
to development and designing Apache Spark programs and algorithms.

Optimizing Spark code, Impala queries and Hive partitioning strategy for
better scalability, reliability and performance.

Work on leading BI technologies like MSTR, Tableau over Hadoop Ecosystem
through ODBC/JDBC connection

Work on hive performance optimizations like using distributed cache for
small datasets, Partition, Bucketing in Hive and Map Side joins.





Reference : Senior Scala/Hadoop Developer jobs

Job details

Apply for this job