Role: Advanced Data Engineer
Contract Length: 4.5 months
Location: Remote (Base location is Cardiff. Will need to collect laptop and may require the occasional day in the office)
IR35: Inside
Pay Rate to Intermediary: Up to £31.18 per hour
Spinwell is recruiting for an Advanced Data Engineer for an excellent opportunity within the public sector.
ADVANCED DATA ENGINEER JOB DESCRIPTION
Core Technical Skills
- Proficient in programming languages including R, Python and SQL; experience with R desirable.
- Experience with relational databases and data warehousing.
- Experience using Git-based version control systems (e.g. GitHub, GitLab, Azure DevOps) and collaborative software development practices.
- Experience working within Agile delivery environments.
- Experience designing and implementing cloud-native data solutions, preferably on Google Cloud Platform (GCP).
- Experience migrating data platforms, pipelines and services from on-premises infrastructure to cloud environments.
- Strong understanding of data modelling techniques, including conceptual, logical and physical data models.
- Ability to design, build, test and maintain scalable data pipelines and data products.
- Experience implementing CI/CD practices and automated deployment pipelines.
- Experience using containerisation technologies such as Docker.
- Experience designing and implementing ETL/ELT pipelines.
- Experience with workflow orchestration tools (e.g. Airflow, Prefect, Dagster, Cloud Composer).
- Experience working with large-scale datasets and distributed data processing technologies (e.g. Spark, Dataproc, BigQuery).
- Experience monitoring, troubleshooting and optimising data pipelines and platform performance.
- Understanding of DevOps and DataOps principles.
- Experience working with APIs and data integration techniques.
Data Engineering and Architecture
- Understanding of how data platforms integrate with wider organisational systems.
- Experience with metadata management, data catalogues and data lineage tools.
- Experience implementing data quality assessment, data profiling and data validation frameworks.
Governance and Security
- Knowledge of information governance, data protection legislation (including UK GDPR and Data Protection Act 2018), and secure data handling practices.
- Understanding of ethical considerations associated with the use of data and analytics.
Software Engineering Practices
- Ability to design, develop, test, document and maintain production-quality code and data pipelines.
- Experience conducting code reviews and applying software engineering best practices, including refactoring, testing and technical documentation.
Communication and Stakeholder Engagement
- Ability to communicate effectively with technical and non-technical stakeholders and work collaboratively within multidisciplinary teams.
- Ability to translate business requirements into technical data solutions and communicate technical concepts to diverse audiences.
Qualifications
- Undergraduate degree in Computer Science or related technical field. Will also consider equivalent work experience
- GCP Data Engineer / Architect certification desirable
If you are an Advanced Data Engineer, apply now or send your CV to Spinwell!
We welcome all applications regardless of background, in line with our commitment to diversity, equality and inclusion.
Applying to this or any other vacancy advertised by Spinwell Ltd constitutes an agreement for Spinwell Ltd to hold your details for 24 months for the purpose of assessing suitability for the advertised position and to make you aware of any other positions deemed suitable of which You will make you aware by means of either email, text or phone. In line with GDPR regulations you are able to request your details be removed from the company data at any time by emailing us