GCP Data Engineer (Senior) with skills Data Engineering, Big Data for location Bangalore, India
ROLES & RESPONSIBILITIES
Responsibilities
· Design, code, and develop new features/fix bugs/add enhancements
· Analyze and improve efficiency, scalability and stability of various system resources
· Lead and Mentor junior engineers and drive a culture of technical perfection.
· Drive creative and innovative solutions to complex problems, exemplifying good technical discernment.
· Drive improvements and new approaches to address potential systemic pain points and technical debt, anticipate and avoid problems.
· Take a hands-on approach in the development of prototypes, independently and with others, to establish design decisions and/or technical feasibility.
Evaluate, Install, Setup, Maintain and Upgrade, Data Engineering, Machine Learning and CI/CD infrastructure tools hosted on Cloud (GCP/AWS)
Drive the CI/CD infrastructure tooling related work in collaboration with various internal teams to get the user stories, epics, goals to closure
Propose, participate, implement architecture level enhancements/changes strategically through Dev/Stage/Prod environments
Design, evangelize, deliver comprehensive best practices & efficient usage of available tooling resources/capabilities to run high-performance systems
Provide innovative & strategic solutions along with cost & risk analysis, to improve stability, scalability, performance of the tools' infrastructure
Perform troubleshooting, analysis, and resolution of environmental issues
Innovate and automate processes/tasks to improve operational efficiency
Document and maintain application setup, runbooks, administration guides and troubleshooting guides
Required Skills:
· Proficiency with a deep learning framework such as TensorFlow
· Experience in building data engineering pipelines
· Experience in Python, Spark/PySpark/Hadoop.
· Understanding or hands on experience with ML Platforms like Google Vertex AI.
· Expertise in building Cloud Native application (GCP/AWS)
· Programming Skills
o Algorithms
o Design Skills
o Refactoring Skills
o Debugging Skills
o Unit testing Skills
· CI/CD
o Jenkins
o Github Actions
· Database
o SQL Databases (Oracle/MySQL/MSSQL etc.,)
o No SQL Databases
o Data Lake, Snowflake, Big Query
Education:
· Graduate in any discipline
Experience:
· 5 - 7 Years.
EXPERIENCE
- 6-8 Years
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Data Engineering
- Additional Skill(s): Big Data
ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.