Big Data Engineer

Senior Lead Software Engineer

Skill: Big Data Engineer

Experience: 7 Years

Strong functional knowledge/Experience of the domain Banking.

Responsibilities

• Develop and optimize data pipelines using Spark, Hive, and Python on Cloudera.
• Develop real-time data workflows using Kafka.
• Design and develop APIs for data access and integration.
• Work with Hue, Oozie and other Cloudera tools for job orchestration and data access.
• Deploy solutions on cloud platforms AWS, Azure, or GCP.

Required Skills and Experience

• 7 plus years of experience in Big Data engineering.
• Hands on with Cloudera, Spark, Hive, Kafka, Python, Hue, and Ranger.
• Strong understanding of distributed systems and cloud data services.
• Proficient in API development and data security controls.

About Virtusa

Add the Middle East to your global professiona...