Sr. Data Engineer, Remote, 10-12 Yrs Exp
Position:-Sr. Data Engineer
Responsibilities :
Design and implement data pipelines for data ingestion, transformation, and storage using AWS services.
Ensure data quality and consistency through validation, monitoring, and automated checks.
Optimize Amazon Redshift and Athena queries for performance and efficiency.
Build and maintain data infrastructure on AWS, including data lakes (Amazon S3) and data warehouses (Amazon Redshift).
Develop and maintain ETL/ELT processes using AWS Glue, Lambda, and Step Functions.
Collaborate with Data Scientists and Machine Learning Engineers to understand and fulfill data requirements.
Implement data governance, lineage, and security best practices leveraging AWS Lake Formation and IAM.
Automate data pipeline deployments using CI/CD tools such as AWS CodePipeline and CodeBuild.
Qualifications:
Bachelor’s degree in Computer Science, Information Systems, or a related field.
Strong experience in data warehousing and ETL/ELT processes.
10+ years of experience in data engineering.
Proficiency in SQL and experience with Amazon Redshift and/or Athena.
Experience with AWS data services (e.g., S3, Glue, Lambda, Redshift, Kinesis, EMR).
Programming skills in Python or other relevant languages.
Knowledge of data modeling and database design.
Experience with data pipeline orchestration tools (e.g., AWS Step Functions, Airflow on AWS).
Strong problem-solving and troubleshooting skills.
Familiarity with LLMs and their application in improving data quality or automating data engineering processes.
Job Type: Full-time
Pay: ₹2,000,395.35 - ₹3,540,348.25 per year
- Experience:
- Data Engineering: 10 years (Required)
- ETL: 10 years (Required)
- Athena: 10 years (Required)
Work Location: Remote
Apply Job!