About Analytics Vidhya
Analytics Vidhya is a leading platform for data science professionals, learners, and organizations. With a community of over 4 million users, we aim to empower everyone to learn, share, and grow in the fields of data science, machine learning, and artificial intelligence. Join
us to be at the forefront of transforming businesses through data!
Role Overview
We are seeking a Data Engineer who is passionate about building scalable data pipelines and infrastructure to support machine learning, analytics, and business intelligence. You will work closely with data scientists, product managers, and developers to ensure robust, secure, and efficient data systems.
Key Responsibilities
● Design, build, and maintain ETL / ELT pipelines using modern data engineering tools and frameworks.
● Develop and optimize data lakes and data warehouses (e.g., Databricks, Redshift, BigQuery,)
● Conduct exploratory queries and build scripts to understand and improve data models
● Develop dashboards and reports in partnership with the UX team and establish visualization standards
● Translate business requirements into scalable data models and tools
● Work with large-scale structured and unstructured data from multiple sources.
● Implement data validation, monitoring, and governance frameworks.
● Collaborate with data scientists and analysts to provide clean, organized, and real-time data
● Ensure data privacy, security, and compliance across all data processes.
● Participate in system architecture discussions and contribute to backend engineering
tasks.
Required Skills
● Strong proficiency in SQL, Python, and data modeling.
● Experience in Databricks / Snowflake
● Experience with Spark, Airflow, or similar data orchestration tools.
● Familiarity with cloud platforms (AWS, GCP, or Azure) and storage systems (S3, GCS).
● Understanding of CI/CD pipelines and DevOps principles for data workflows.
● Hands-on experience with real-time data streaming tools (Kafka, Flink, etc.) is a plus.
● Experience in scaling generative AI models and agentic workflows is a plus
● Solid understanding of APIs, microservices, and RESTful design.
Qualifications
● Bachelor’s or Master’s degree in Computer Science, Data Engineering, Mathematics or
related field.
● 2+ years of experience in a data engineering or backend data role.
● Exposure to machine learning pipelines or MLOps is a bonus.
Why Join Us?
● Work with a mission-driven, high-impact team.
● Access to cutting-edge tools and real-world data projects.
● Learn and grow in one of India’s most respected data science communities.
● Flexible work environment and continuous learning support.
