Home / Jobs / Job Details

Data Engineer - Databricks

Vestas India
Location: Chennai, Experience: 5 years - 7 years
Posted On: 20-Aug-2024 | Last Date to Apply: 30-Sep-2024 | No: of Vacancies : 1

Company Profile:

Vestas is the world leader in wind technology and a driving-force in the development of the wind power industry. Vestas’ core business comprises the development, manufacture, sale, marketing, and maintenance of Wind Turbines. Come and join us at Vestas! We have a comprehensive and diverse team that consists of everything from Health Monitoring Engineers/Specialists and Reliability Engineers/ Specialists, Data engineers, Data Analysts, and Data Scientists. Vestas Modelling & Analytics module is on a journey of transitioning into a Cloud based data platform for condition monitoring data. You will be the core Data engineer responsible for design and implementation of this transition and become the design owner of the new cloud based platform for modern data product offerings of Condition monitoring data. The primary scope of work will be sourcing of data from distributed on-premise data systems to one centralized Databricks infrastructure.

Job description:

Responsibilities

Design and support database and table schemas for new and existent data sources

Translate business needs into technical data designs Design and implement implementation of ETL (Extract, Transform, Load) data pipelines

Work on feasibility studies of new technologies through proof of concepts

Work with data science and analytics development teams in Plant Monitoring & Reliability area and cross functional teams across M&A Module and IT teams (Digitalization) to ensure best practice, performance and reliability is in place

 

Qualifications

Minimum of 5-7 years' Relevant experience with Masters' or PhD degree in STEM (Science, Technology, Engineering, and Mathematics)

Work experience where data engineering and Data warehouse development was a major part of your work Experience in automating software deployments & tests, and following a continuous delivery and deployment model

Experience with mathematical modeling

 

Competencies

Must have Databricks, Spark, Pandas, Python, Azure cloud, Data factory, SQL, Data/DeltaLake, git, Azure DevOps, testing, CI/CD

Good to have; Cloud infrastructure deployment and IaC, Azure Biceps and ARM templates, Snowflake, Snowpark, Unity Catalog, dbt, Scala/Rust/R Familiarity with: Statistics, signal processing, Jupyter notebooks, data testing, and data science best-practices

Data warehouse data models and proficiency with ETL tools

MS SQL, SSIS, SSAS (MDX/DAX)

JIRA or similar tools

Experience with Cloud platform (SNOWFLAKE)

Knowledge of Kafka, C#

DevOps process and associated tools, e.g. Azure DevOps

 

 

Key Qualifications

Masters

Education

M.E

Additional Requirements

Minimum of 5-7 years' Relevant experience with Masters' or PhD degree in STEM (Science, Technology, Engineering, and Mathematics).

Skills

Azure,Azure Data Factory,c#,Data analytics,Data Analytics Testing,ETL,ETL SQL/PLSQL /SAP BW,Kafka,Ms SQL,Spark,SSAS,SSIS,azure devops,snowflake,ZIRA,

Industry

Manufacturing

Gender Preference:

Female

Job Type:

Full Time

Diversity Tags:

Not Applicable