Azure Data Engineer (Senior) with skills Oracle ADF, Azure Data Factory, synapse, databricks, Azure Datalake for location Bangalore, India
ROLES & RESPONSIBILITIES
Core Skills
Databricks + SQL combination is must
? Over all 6 to 9 years of experience Cloud data engineering, out of which minimum of 3 to 5 years experience in Azure Databricks, PySpark.
? Proficient in SQL and must worked on complex joins, Subqueries, functions, procedure. and able to perform SQL tunning and query optimization without support. Ideally 5 to 6 years of solid experience in SQL queries
? Design, develop, and maintain ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data from various sources.
? Experience in implementing large & complex hosted solution using Azure (ADF, Azure Data Lake Storage and databricks.
? Optimize and fine-tune existing ETL workflows for performance and scalability.
? Must have experience on working with large data set
? Experience working with batch and streaming data processing (Good to have).
? Ability to develop reliable, secure, compliant data processing systems.
? Work closely with cross-functional teams to support data analytics, reporting, and business intelligence initiatives.
? One should be self-driven and work independently without support.
EXPERIENCE
- 6-8 Years
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Oracle ADF, Azure Data Factory
- Additional Skill(s): synapse, databricks, Azure Datalake
ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.