We are looking for a Cloud Engineer who has experience in Developing Data Distribution Solutions on Cloud Platform.
You will be primarily responsible for the following activities but not just limited to these
Develop End-to-End data pipelines and ETL processes on the GCP platform to ingest, process, and transform large volumes of data from various sources.
Perform Data Engineer tasks to Develop the reusable workflows in GCP Data Ingestion
Perform Proof of Concept by evaluating options for building Data warehouse in GCP Platform
Build Configurable & Scalable Data Ingestion solutions on GCP Platform
Understand the data pipelines, identifying bottlenecks and optimizing performance and cost
Prepare documentation for Data Engineering objects and operational processes.
Understand the Projects lifecycle, take active role in Production deployments and resolve deployment issues
Understand Functional requirements and develop as per Detailed Technical specifications
Establish and maintain cross-functional working relationships with other IT groups (including Production Support, Cloud Admin Team etc.) and key business stakeholders
Where you'll be working…
In this hybrid role, you'll have a defined work location that includes work from home and assigned office days set by your manager.
What we’re looking for...
We are looking for a Cloud Engineer with Hands-On Experience in implementing Push/Pull Message Queueing (Data Distribution) solutions on Cloud Platform
Bachelor’s degree or two or more years of experience.
Two or more years of total IT Experience including 1+ years of Cloud Platform Experience
Experience in building Data Pipelines for Batch/Stream process on GCP/Azure/AWS cloud
Hands-on experience in Big Query, Composer/Air Flow, Cloud Functions, GCS, SQL Programming
Hands-on Experience in GCP & Python is mandatory
Hands-on experience in CI/CD Jenkins, Terraform etc.
Well versed with Agile Development Methodologies
Excellent written and spoken communication skills
Even better if you have one or more of the following…
Experience on GCP Big Query, Data Transfer Services, GCP Data Proc and Data Flow
Knowledge of CI/CD Implementation on Cloud Platform
Knowledge of Cloud Orchestration & Workflow scheduler Tools
Knowledge on Reporting tools like Looker, Qlik etc.
Certification on data engineering technologies preferably GCP Professional Data Engineer
Experience in analyzing large amounts of information to discover trends and data
Experience with Data Quality and Performance Tuning
Bachelors
Data Engineer,Data flow,GCP,Python,sql,data proc,
IT-Software- Software services