Data Engineer –
Azure Databricks
& SQL
Job Summary
We are seeking an experienced Data Engineer with strong expertise in
Azure Databricks
and SQL to join our growing data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and supporting the migration of legacy data platforms into
Azure Databricks.
The role requires hands-on experience in data warehousing, ETL development, data modeling, and Azure cloud technologies.
Key Responsibilities
Design, develop, and maintain scalable ETL/data pipelines.
Build and optimize batch and streaming data processing solutions using
Databricks
and Apache Spark.
Support migration of legacy data platforms into
Azure Databricks.
Develop and maintain enterprise data warehouse solutions.
Create and optimize SQL queries for large-scale datasets.
Implement data models including dimensional modeling and star schema design.
Work with Azure Data Factory (ADF), SSIS, and related ETL tools.
Manage data governance, lineage, and security using Unity Catalog.
Implement CI/CD pipelines using Git and Azure DevOps.
Ensure data quality, reliability, performance, and compliance standards.
Collaborate with cross-functional teams including BI, analytics, and business stakeholders.
Stay updated with latest
Databricks
and Azure platform enhancements.
Required Skills
5–8 years of experience as a Data Engineer.
Strong hands-on experience in SQL development and performance tuning.
Extensive experience with
Azure Databricks and Apache Spark.
Strong experience in Data Warehousing and Data Modeling.
Hands-on experience with:
Azure Data Factory (ADF)
Databricks
SSIS
ETL Development
Experience with Unity Catalog for governance and security.
Knowledge of Azure Data Lake and Azure Storage.
Experience building both batch and streaming pipelines.
Familiarity with Azure DevOps, Git, and CI/CD processes.
Good understanding of data governance and security best practices.
Power BI knowledge is an added advantage.
Excellent communication and problem-solving skills.
Preferred Qualifications
Bachelor’s degree in Computer Science, Engineering, IT, or related field.
Experience working in enterprise-scale cloud data platforms.
Exposure to Agile methodologies.
At Tech Vedika, we are looking for talented individuals who want to work with driven people. Attain success while working on interesting projects with a culturally diverse group of individuals.
Perks & Benefits:
Health Insurance
Meal Vouchers
Learning Aids
Client/Customer Interactions
Working with great minds
If you want an exciting and dynamic career with unlimited growth potential, then Tech Vedika is the place for you!
