Data Engineer – Unity Catalog Migration

Role: Data Engineer – Unity Catalog Migration

Location: Gurgaon

Experience: 5+ Years

Immediate Joiners

Senior Data Engineer - Unity Catalog Migration

• 5-8+ years in data engineering with proven large-scale migration experience (500+ notebooks minimum)
• Strong hands-on PySpark proficiency including RDD operations, DataFrame/Dataset APIs, and performance optimization
• Deep Unity Catalog migration experience : Hive metastore to UC, mount-to-volume patterns, RBAC implementation
• Testing : Perform end-to-end validation of Unity Catalog migrated notebooks, tables, volumes, and data pipelines to ensure functional correctness and data integrity.
• Hands-on experience with Azure Databricks, UCX tool, and Azure Data Factory orchestrat...