Technical Lead for Data engineering

Job Summary:

  • We are seeking a highly skilled and experienced Data engineering
    Key Responsibilities:
  • Minimum 7 yrs with Data engineering

Mandatory Skills:
AWS Services ( S3, Lambda, Glue, Step function, Redshift), Python
Data Pipeline Development:
 Design, develop, and maintain scalable data pipelines to ingest and transform data from multiple sources
using AWS services like S3, Glue, and Redshift.
 Implement best practices for ETL/ELT processes, optimizing performance, reliability, and data quality.
Data Management & Storage:
 Manage data storage and retrieval strategies using Amazon S3 for structured and unstructured data.
 Leverage Redshift for data warehousing needs, performing database operations to support analytics and
reporting.
Data Transformation & Processing:
 Use AWS Glue to develop and orchestrate data transformation processes, ensuring data is clean,
consistent, and optimized for analysis.
 Write Python scripts for data manipulation, transformation, and integration, handling data from various
sources and in different formats.

Data Quality & Monitoring:
 Implement monitoring and alerting mechanisms for data pipelines and ensure high data integrity and
performance.
 Conduct data quality checks, validations, and troubleshooting to resolve any data-related issues.

Qualification : Any Graduation
Work Location : Bangalore/Mumbai/Hyderabad/Chennai