Contract

Azure Data Engineer

SalaryCompetitive
LocationNetherlands
SectorIT

Description

Concilium Search is an executive search and interim workforce solutions business headquartered in London with offices in New York and Amsterdam. The IT Division here specialize in placing contractors in Opensource Development, DevOps, and Architecture. This featured position is for an Azure Data Engineer, to be based in Amsterdam, Netherlands

 

Job Title: Azure Data Engineer

Duration: 6 Months

Location: Amsterdam, Netherlands

Job description as requested.

  • Extensive ingesting, cleaning, transformation and aggregation of massive amounts of data from multiple internal and external sources (Salesforce, Google Analytics, Amazon S3 Storage bucket, SAP etc...) by using Azure Databricks (Pyspark)
  • Create data pipeline that enable various systems within ecosystem to stream high volume data from multiple sources into central repository for processing
  • Experience building data pipeline by using Azure Big data stack
  • Setup and Configuration of Azure Databricks
  • Reporting at scale enabled by Databricks Delta for incremental processing
  • Understanding of spark framework and tuning of spark applications Extensive experience with horizontally scalable and highly available system design and implementation, with focus on performance and resiliency
  • End-to-End solution containing of Spark, Azure SQL, Azure Data Lake, Azure Data Factory and Power BI (for visualization)
  • Exposure to Data & Analytics, Cloud technologies
  • Setup different cloud environments for Dev, QA and Prod

Should have recent Azure experience

Apply Today

Related Jobs

You may also be interested in these similar roles
  • Salary
    Competitive
    Location
    Luxembourg, Luxembourg
    Sector
    IT
    Concilium Search is an executive search and interim workforce solutions business headquartered in...
  • Salary
    Competitive
    Location
    Luxembourg, Luxembourg
    Sector
    IT
    Concilium Search is an executive search and interim workforce solutions business headquartered in...
  • Salary
    Competitive
    Location
    Poland
    Sector
    IT
    Concilium Search is an executive search and interim workforce solutions business headquartered...
  • Salary
    Competitive
    Location
    Poland
    Sector
    IT
    Concilium Search is an executive search and interim workforce solutions business headquartered...