Job Summary:
We are looking for an experienced Technical Lead with strong expertise in Azure Databricks to design and lead data engineering solutions. The candidate will be responsible for building scalable data pipelines, guiding the team, and ensuring successful delivery of data projects.
Key Responsibilities:
Design and develop data pipelines using Azure Databricks
Lead and mentor data engineering team members
Work with stakeholders to understand business requirements
Ensure high performance, scalability, and reliability of data solutions
Optimize ETL/ELT processes and data workflows
Collaborate with architects and cross-functional teams
Review code and ensure best practices are followed
Required Skills:
Strong experience in
Azure Databricks
Hands-on experience with
Azure Data Factory (ADF), ADLS, Azure SQL
Good knowledge of
PySpark / Spark / SQL
Experience in
data warehousing and ETL/ELT processes
Strong problem-solving and leadership skills
Preferred Skills:
Experience with Power BI or reporting tools
Knowledge of CI/CD and DevOps practices
Azure certifications (DP-203, AZ-900, etc.)
