Azure Data Engineer (Lead) with skills Oracle ADF, Azure Data Factory, synapse, databricks, Azure Datalake for location Bangalore, India
ROLES & RESPONSIBILITIES
Core Skills
? Over all 9 to 12 years of experience Cloud data engineering, out of which minimum of 5 to 6 years experience in Azure Databricks, PySpark.
? Proficient in SQL and must worked on complex joins, Subqueries, functions, procedure. and able to perform SQL tunning and query optimization without support and guide the team as require. Ideally 7 to 8 years of solid experience in SQL
? Excellent hands-on experience in design & development of ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data for verity of sources.
? Must have good worked experience on Delta tables, deduplication, merging with terabyte of data set
? Optimize and fine-tune existing ETL workflows for performance and scalability. 3 to 5 years of experience in ADF is desirable (Medium expertise require)
? Experience working with batch and streaming data processing (Good to have).
? Ability to develop reliable, secure, compliant data processing systems.
? Work closely with cross-functional teams to support data analytics, reporting, and business intelligence initiatives and suggest suitable technical solution.
? Technically strong to help the team on any technical issues they face during the execution.
? Owns the end-to-end technical deliverables.
EXPERIENCE
- 8-11 Years
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Oracle ADF, Azure Data Factory
- Additional Skill(s): synapse, databricks, Azure Datalake
ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.