Job Description: Technical Architect (DataBricks, BigData, Python & PySpark):
10+ years of experience in data engineering with strong proficiency in Python and PySpark.
3–5+ years of hands-on experience with Databricks platform on Azure, AWS, or GCP.
Deep understanding of Apache Spark internals and distributed computing concepts.
Strong knowledge of Delta Lake, Lakehouse architecture, and data lake management.
Proven experience with large-scale Big Data platforms (Hadoop, Hive, HDFS, etc.).
Proficiency in SQL and working with relational and non-relational databases.
Solid understanding of CI/CD, version control (Git), and DevOps for data pipelines.
Experience with data orchestration tools (e.g., Airflow, Azure Data Factory).
Experience in data warehouse design and maintenance
Experience in agile development processes using Jira and Confluence.
Experience in cross-functional teams.
Understanding on the SDLC.
Understanding on the Agile methodologies.
Communication with customer and producing the Daily status report.
Should have good oral and written communication.
Should be a good team player.
Should be proactive and adaptive.
