Senior Data Engineer - Spark and Scala Specialist

Power Programmer - Senior Technologist. Data Engineering (Q2-FY-26) Indepth hands on experience of developing, testing, deployment and debugging of Spark Jobs using Scala in Hadoop Platform In depth knowledge of Spark Core, working with RDDs, Spark SQL In depth knowledge on Spark Optimization Techniques and Best practices Good Knowledge of Scala Functional Programming: Try, Option, Future, Collections Good Knowledge of Scala OOPS: Classes, Traits and Objects (Singleton and Companion), Case Classes. Scala Language Features: Type System, Implicit/Givens Hands on experience of working in Hadoop Environment (HDFS/Hive), AWS S3, EMR, Workflow Orchestration tools like Airflow, Oozie Understanding and exposure to file formats such as Apache AVRO, Parquet, JSON Writing Test cases using frameworks such as scalatest. Experience on using GIT, resolving conflicts, working with branches. Strong programming skills using data structures and algorithms. Mandatory AWS Glue, AWS Redshift/Spectrum, S3, A...