Company Profile:

Job description:

Job Title: - Data Engineer- Data Services, GCP

1. 1. Role and Responsibilities

As a GCP Data Engineer he will be responsible for expanding and optimizing our data and data pipeline architecture on google cloud, as well as optimizing data flow and collection for cross functional teams.

He should be able to design, build, operationalize, secure, and monitor data processing systems with a particular emphasis on security and compliance; scalability and efficiency; reliability and fidelity; and flexibility and portability. A Data Engineer should also be able to leverage, deploy, and continuously train pre-existing machine learning models. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up on Google cloud services. The GCP Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

• Designing, building, operationalizing, securing, and monitoring data processing systems on Google Cloud Platform.
• Deploying, leveraging, and continually training and improving existing machine learning models.
• Identifying, designing, and implementing internal process movements.
•  Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
•  Working with large datasets and solving difficult analytical problems is a primary task of a Google data engineer.

• Conducting end-to-end analyses, including data collection, processing, and analysis.
• Building prototype analysis pipelines to generate insights. 
• Developing comprehensive abilities for Google data structures and matrix for upcoming product development and sales activities is also a crucial task for Google data engineers.
• Finding trends in data sets and developing an algorithm to make raw data more useful across teams.
• Automating manual processes to enhance delivery. 
• Meeting business objectives in collaboration with data scientist teams and key stakeholders.

• Develop and build data processing systems using GCP services.
• Cleansing of data using dataprep /python/Spark
• Experience with : Python / Java,Spark & Hive / SQL and understanding of software vulnerabilities.
• Experience in Bigquery ,Dataflow, Dataproc,Pub/Sub etc.
• Good understanding of data warehousing principles and design / loading / updating / creating star schema and fact tables.
• 5+ years of increasing responsibility architecting, positioning and delivering cloud / internet facing applications In-depth knowledge on GCP and Cloud technologies.
• At least 5 years of proven experience in Data Engineering services in Big Data  Cloud (GCP) environment.

Any Degree, BE/B.Tech or MSc, MCA from a reputed institute.