Job Summary:
- We are seeking a highly skilled and experienced Data engineering
Key Responsibilities: - Minimum 7 yrs with Data engineering
Mandatory Skills:
AWS Services ( S3, Lambda, Glue, Step function, Redshift), Python
Data Pipeline Development:
Design, develop, and maintain scalable data pipelines to ingest and transform data from multiple sources
using AWS services like S3, Glue, and Redshift.
Implement best practices for ETL/ELT processes, optimizing performance, reliability, and data quality.
Data Management & Storage:
Manage data storage and retrieval strategies using Amazon S3 for structured and unstructured data.
Leverage Redshift for data warehousing needs, performing database operations to support analytics and
reporting.
Data Transformation & Processing:
Use AWS Glue to develop and orchestrate data transformation processes, ensuring data is clean,
consistent, and optimized for analysis.
Write Python scripts for data manipulation, transformation, and integration, handling data from various
sources and in different formats.
Data Quality & Monitoring:
Implement monitoring and alerting mechanisms for data pipelines and ensure high data integrity and
performance.
Conduct data quality checks, validations, and troubleshooting to resolve any data-related issues.
Qualification : Any Graduation
Work Location : Bangalore/Mumbai/Hyderabad/Chennai