AWS Data Engineer (Standard) with skills Data Engineering, Python, ETL, SQL, AWS Glue for location Gurugram, India
ROLES & RESPONSIBILITIES
Primary Responsibilities
Develop and maintain data processing scripts using Python (Pandas, NumPy)
Build and manage ETL workflows using AWS Glue
Implement event-driven and batch processing using AWS Lambda
Ingest data from SFTP locations, email deliveries, and flat files (CSV)
Handle complex CSV structures, including:
Non-standard or multi-row headers
Dynamic column positioning
Reading data using column index-based logic
Integrate and consume REST APIs for data ingestion
Perform data validation, cleansing, transformation, and enrichment
Collaborate with data engineering, analytics, and business teams
Support production deployments, monitoring, and issue resolution
?? Required Skills
Strong proficiency in Python, especially Pandas and NumPy
Hands-on experience with AWS Glue and AWS Lambda
Experience working with CSV files having complex or irregular headers
Strong understanding of ETL concepts and data transformation
Experience in ingesting data from SFTP and file-based sources
Basic to intermediate knowledge of SQL and relational databases
Good problem-solving, debugging, and data analysis skills
?? Good to Have
Exposure to cloud data architectures (AWS preferred)
Experience with email-based data ingestion or automated file handling
Understanding of data security, access controls, and PII handling
Familiarity with Agile delivery environments
EXPERIENCE
- 3-4.5 Years
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Data Engineering
- Additional Skill(s): Python, ETL, SQL, AWS Glue
ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.