Role: Senior Data Engineer
Contract Length: tbc
Location: Hybrid/London – 3 days per week in office
IR35: Inside
Pay Rate to Intermediary: Market Rate
Security Clearance: SC requested
Spinwell is recruiting for a Senior Data Engineer for an excellent opportunity within the public sector.
RESPONSIBILITIES OF THE SENIOR DATA ENGINEER
The client is seeking a highly skilled and experienced Senior Data Engineer to join their team and contribute to the development and maintenance of their cutting-edge Azure Databricks platform for economic data. This platform is critical for their Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets.
SKILLS/EXPERIENCE OF THE SENIOR DATA ENGINEER
- 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.
- Good proficiency in Python and Spark (PySpark) or Scala.
- Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.
- Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.
- Experience working with large datasets and complex data pipelines.
- Experience with data architecture design and data pipeline optimization.
- Proven expertise with Databricks, including hands-on implementation experience and certifications.
- Experience with SQL and NoSQL databases.
- Experience with data quality and data governance processes.
- Experience with version control systems (e.g., Git).
- Experience with Agile development methodologies.
- Excellent communication, interpersonal, and problem-solving skills.
- Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs).
- Experience with data visualisation tools (e.g., Tableau, Power BI).
- Experience with DevOps tools and practices (e.g., Azure DevOps, Jenkins, Docker, Kubernetes).
- Experience working in a financial services or economic data environment.
- Azure certifications related to data engineering (e.g., Azure Data Engineer Associate
If you are a Senior Data Engineer, apply now or send your CV to Spinwell!
We welcome all applications regardless of background, in line with our commitment to diversity, equality and inclusion.
Applying to this or any other vacancy advertised by Spinwell Ltd constitutes an agreement for Spinwell Ltd to hold your details for 24 months for the purpose of assessing suitability for the advertised position and to make you aware of any other positions deemed suitable of which You will make you aware by means of either email, text or phone. In line with GDPR regulations you are able to request your details be removed from the company data at any time by emailing us