GCP Data Engineer (Senior) with skills Data Engineering, Big Data for location Bangalore, India
ROLES & RESPONSIBILITIES
Responsibilities
· Design, code, and develop new features/fix bugs/add enhancements
· Analyze and improve efficiency, scalability and stability of various system resources
· Lead and Mentor junior engineers and drive a culture of technical perfection.
· Drive creative and innovative solutions to complex problems, exemplifying good technical discernment.
· Drive improvements and new approaches to address potential systemic pain points and technical debt, anticipate and avoid problems.
· Take a hands-on approach in the development of prototypes, independently and with others, to establish design decisions and/or technical feasibility.
Evaluate, Install, Setup, Maintain and Upgrade, Data Engineering, Machine Learning and CI/CD infrastructure tools hosted on Cloud (GCP/AWS)
Drive the CI/CD infrastructure tooling related work in collaboration with various internal teams to get the user stories, epics, goals to closure
Propose, participate, implement architecture level enhancements/changes strategically through Dev/Stage/Prod environments
Design, evangelize, deliver comprehensive best practices & efficient usage of available tooling resources/capabilities to run high-performance systems
Provide innovative & strategic solutions along with cost & risk analysis, to improve stability, scalability, performance of the tools' infrastructure
Perform troubleshooting, analysis, and resolution of environmental issues
Innovate and automate processes/tasks to improve operational efficiency
Document and maintain application setup, runbooks, administration guides and troubleshooting guides
Required Skills:
· Proficiency with a deep learning framework such as TensorFlow
· Experience in building data engineering pipelines
· Experience in Python, Spark/PySpark/Hadoop.
· Understanding or hands on experience with ML Platforms like Google Vertex AI.
· Expertise in building Cloud Native application (GCP/AWS)
· Programming Skills
o Algorithms
o Design Skills
o Refactoring Skills
o Debugging Skills
o Unit testing Skills
· CI/CD
o Jenkins
o Github Actions
· Database
o SQL Databases (Oracle/MySQL/MSSQL etc.,)
o No SQL Databases
o Data Lake, Snowflake, Big Query
Education:
· Graduate in any discipline
Experience:
· 5 - 7 Years.
EXPERIENCE
- 6-8 Years
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Data Engineering
- Additional Skill(s): Big Data