Years of experience:
8 to 10 years
Focus:
Reliability, Automation, and Data Quality. The Engineer turns the architect's blueprint into a working, automated reality.
Key Responsibilities:
Build and maintain
ETL/ELT pipelines
to move data from source to storage.
Implement automated data quality testing and observability alerts.
Optimize data storage formats (e.g., Parquet, Delta Lake) for high-speed querying.
Manage
CI/CD pipelines
for data code deployment.
Create interactive visualizations with actionable insights by persona
Deliverables:
Production-ready optimized data pipelines, Cleaned datasets, interactive & intelligent dashboards.
Tech Stack - AWS
Data Ingestion & Processing :
AWS API Gateway, AWS Lambda, AWS Glue ETL, AWS Glue Crawler
Data Storage & Analytics :
Amazon S3, Amazon Redshift (Data Warehouse), Amazon Athena
Governance & Security :
AWS Lake Formation, AWS IAM, AWS CloudTrail, Amazon CloudWatch
AI & Analytics :
AWS Bedrock
Visualization :
Amazon QuickSight
Visa Requirement:
Preferred USA B1 Business Visa with a minimum validity of 2 years
