- Pay Rate:
£21.73 per hour PAYE
- Hours per Week:
37 Monday – Friday, 08:00 - 16:00
This opening assignment is for 4 months
- LINCOLN,
LN2 2LT
Interim Senior Data Engineer - Digital And Data Solutions
Reference no: Lincolnshire BL TCL 360388
Pay Rate: £21.73 per hour PAYE
37 Monday – Friday, 08:00 - 16:00
This opening assignment is for 4 months
City: LINCOLN
Hybrid working
Management Vetting
NB: Police Vacancy - only for candidates with a minimum of 5 years continuous UK address history. Please note that this vacancy is subject to a strict security vetting procedure.
The Senior Data Engineer will be accountable for and have lead responsibility for designing, building, and maintaining the data infrastructure, ensuring the efficient and reliable definition, processing, storage, and analysis of large datasets. The role is integral to the Force being able to create value from all the data it collects by leading the data engineering activities required to improve and combine data from first contact with the public through to crime intelligence and the back-office.
They will make a significant contribution to making sure our data, and data shared by others is of the highest quality, available, usable and shareable by rigorous standard setting and quality control. The role requires a highly comprehensive level of knowledge, functional understanding of modern data technologies and platforms and as sole accountable data engineer for the Force will need to excel in the application data engineering tools and methodologies. They will cultivate strong and effective working relationships with individuals, teams and colleagues, both internal and external to the Force. In particular they will work performance, information and data analysts specialising in crime, justice, vulnerable populations, public safety across the Force, from other Forces and public sector partners to build products and services which deliver insight and value to the Force and its ability to make Lincolnshire a safe place to live, work and visit
Key responsibilities:
- Lead the design and implement of scalable, efficient, and robust data pipelines to extract, transform, and load (ETL) data from various sources into data storage and platform solutions.
- Engage and collaborate with cross-functional teams, to understand their data requirements and translate them into technical solutions.
- Build and link data sets so that data scientists and analysts can easily derive insights, including accessing sensitive data held in back-end systems, extracting and loading into the data storage environment (warehouse or lake) or platform (fabric or mesh, whichever strategically appropriate) from which they be provisioned.
- Write ETL scripts and code to make sure the ETL process performs optimally, leading on extracting data, joining and helping analysts to derive insights.
- Lead the build and be accountable for the optimising the performance of pipelines and APIs that connect operational systems, data for analytics and business intelligence (BI) systems, troubleshooting and resolving issues as they arise, to ensure the timely delivery of high-quality data.
- Provide leadership to the business in automating its manual data flows and reporting processes, enabling their scaling up and repeatable use, working with leaders across the organisation to identify and elicit the benefits of speeding up and easing access to data.
- Lead the development and maintain data models, schemas, and structures that optimize data storage and retrieval for analytics and reporting purposes.
- Work with the Principal DBA and Principal Solutions Developer to actively optimise code within the Force’s systems to ensure processes perform optimally
- Identify ways to improve data reliability, efficiency and quality
- Engage and work closely with data stakeholders to understand their data needs and provide support and guidance on how to use the data engineering infrastructure effectively
NB: Please feel free to apply to us direct via jo[email protected] by quoting the job reference and job title exactly.
To help speed up the process of uploading your CV to the client we would suggest that you send us your CV in Word format (or equivalent) if possible, rather than as a PDF
If you are successful in securing this role, please note that for the entire duration of this contract, regardless of extension you will be working this role at the PAYE rate that has been advertised. For absolute clarity, we only work on a PAYE basis, rather than entertaining umbrella pay terms, we do not offer Ltd/umbrella or outside IR35 rates. If you wish to understand PAYE vs Umbrella more, please let us know and we can send you some additional information for clarity.
Please quote the Job Title & Vacancy Reference No. in your application, or we will be unable to match your CV to the role being applied for.
Other “Essential Requirements” – Please check to ensure that your CV addresses the following items:
MV Clearance
Qualifications:
- Degree in Computer Science, Information Systems, or a related field. or a combination of education and relevant experience
- Programming land querying languages e.g. SQL, R, Hive, Python, Java, Scala
- Data modelling, ETL data pipeline tools, e.g. Apache Spark, Apache Kafka
Knowledge:
- Detailed and applied knowledge of modern data engineering tools, technologies and practices Understanding of machine learning techniques and algorithms
- Good working knowledge with data governance principles, data privacy regulations (e.g., GDPR, CCPA), and data security best practices.
- Detailed and applied understanding of relational and NoSQL databases, including database design, query optimization, and performance tuning.
Experience:
- Experience demonstrating proficiency as a Data Engineer or similar role, delivering data products and services such as data modelling, data schemas, warehouses and/or lakes
- Experience demonstrating proficiency working with multiple, complex data sets
- Experience demonstrating proficiency and able to give examples of successful, hands-on implementation of ETL processes and delivery of data pipelines into various data management architecture.
Skills & Abilities:
- Demonstrating detailed skills in cleaning, integrating and scaling data sets and pipelines, fixing problems in data sets, from low performance to bugs and outages
- Proficiency in programming languages such as Python, Java, or Scala, used for scripting and automation
- Proficiency in using query languages such as SQL, Hive, R, with any ability to work with SQL and NoSQL databases
- Proficient in modelling data in a range of ways, including reverse engineering from live production systems
- Proficient in building, writing, and executing tests to ensure data pipelines and products meet the needs of the Force
ALD
Give yourself the best chance of success - View our CV Tip
CV Tips
Your CV needs to be current with your most recent role. We won’t be able to submit it with any unexplained gaps in employment. It will save time and improve your chances of success if we can put your CV forward immediately without having to ask for revisions.
Your CV must cover the “Essential Requirements” of the role. Ideally you will address the “Essential Requirements” on each job description page directly, in a bullet point list. Please include any DBS details and other qualifications called for.
Your CV should clearly state that you are available to start work either immediately, or at short notice. In general, our clients are unable to work with notice periods of more than 1 week from the point at which a role is offered, 2 weeks at the very most.
We do not put forward covering letters, so please ensure that your CV in contains all relevant information being called for.
We recommend that you consider sending us a CV suitably tailored CV for each role that you apply for. Job board aggregator sites will generally store only one version of your CV, which can be a bit limiting, so this is to your advantage.