London Prism Digital Ltd 1-2 Paris Garden London SE1 8ND
Azure Data Engineer 2024-04-22 Lead Azure Data Engineer | Power BI, Synapse, Data Factory / Data Lake | Tech for Good / Charity This is the chance to work for a unique organisation! Our client is a not-for-profit charity that reviews/certifies companies, governments and financial institutions for their environmental impact and awareness. Penpole 2024-05-22

Azure Data Engineer

£500 - £650 per day

London
Alex Dover

500 DAY

£500 - £650 per day

GBP
APPLY NOW BACK TO VACANCIES

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good / Charity


Duration: 6-12 months
IR35: Outside
Location: Remote with occasional travel to London (Once every two months max)

 

Essential skills required:

  • Azure – solid experience required of the Azure Data ecosystem
  • Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark
  • Azure Synapse - ESSENTIAL as is used heavily
  • Spark
  • Azure Data Lake / Data Bricks / Data Factory
  • Be happy to act as a lead and mentor to the other permanent Azure Data Engineers

 

This is the chance to work for a unique organisation! Our client is a not-for-profit charity that reviews/certifies companies, governments and financial institutions for their environmental impact and awareness. Our client is the main global authority that certifies and monitors the environmental impact that companies/governments have on the natural environment. Essentially, they provide the equivalent of the “Fair Trade” sticker that you would see on a jar of coffee but for businesses and local governments.

 

The organisation is over 20 years old, headquartered in the UK with an office in central London and has 700 staff globally (100 circa in the UK).

 

You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps.

 

As this is a lead role 50% of your time will be leading and assisting the other data engineers and the other 50% will be hands-on with the tech. Due to the nature of our client’s product and service, they’re a huge data-centric organisation so dealing with larger data sets and managing this data is essential.

 

The tech stack you will be working on is:

  • Azure – a very solid Azure cloud native experience is essential
  • Data platforms on Azure; Synapse, Spark, Azure Data Factory
  • Python
  • Data design patterns, such as medallion architecture & data vault
  • SQL queries, views, stored procs, CTE etc – strong experience required
  • Terraform used for IaC
  • Azure DevOps used for CI/CD
  • DP-203 certification preferred but not essential

 

Specifics you will be working on in this contract:

  • Building data lakes
  • Implement medallion design
  • Created data standardisation and cleansing pipelines across zones/layers
  • Familiar with partitioning and efficient storage patterns
  • Work with high-volume pipelines in batch or streaming mode
  • Data Engineering
  • Configure Azure Synapse components such as integration runtimes, spark clusters and dedicated pools
  • Work with delta tables and Lakehouse architecture
  • Familiar with Synapse CI/CD
  • Azure Purview or another governance tool experience. Familiar with building Catalogs and lineage

 

This is an urgent contract, so if you are interested apply ASAP.

 

Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good / Charity

Job reference: #BBBH11626