Azure Data Engineer (Lead) with skills Data Engineering, ETL, Databricks, Azure Data Factory, Pyspark for location Bangalore, India
ROLES & RESPONSIBILITIES
Experience with Databricks, Pyspark, and handling large volume of data
• Strong experience in data migration, ETL, and data integration processes.
• Proficient in Python and SQL
• Knowledge of data warehousing and data lakes concepts.
• Familiarity with CI/CD processes for data workflows.
• Should be able to perform validation to ensure data integrity, accuracy, and consistency
• Test end-to-end data pipelines for performance, scalability, and fault tolerance
EXPERIENCE
- 8-11 Years
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Data Engineering
- Additional Skill(s): ETL, Databricks, Azure Data Factory, Pyspark
ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.