Data Engineer

You will collaborate directly with our client’s customers to design, build, and maintain custom software solutions that power both the front-end and back-end of multiple web portals. These platforms enable seamless interaction, processing, and management of large volumes of user-generated data. Working within a Scrum team, you will contribute to sprint-based development cycles, delivering valuable features and project milestones. You will use a range of back-end storage and processing technologies and take ownership of a key area of development, maintaining regular communication with customers throughout the project lifecycle.

Company cultures & job summary

• The client is a leading engineering consultancy that helps organizations maximize their return on investment in science and technology. Trusted by governments and industry partners worldwide, they deliver R&D services, independent technical advice, and solutions to complex engineering challenges.
• They focus on understanding each client’s key objectives to provide fully tailored, end-to-end solutions.
• With deep expertise in communication systems, electronic sensors, and information assurance—across both civil and defense sectors—their 350+ engineers and consultants design and develop innovative systems and capabilities that safeguard their clients’ most critical assets.
• The company continues to serve as a UK centre of excellence for innovation and world-class engineering.

Working Patterns and location – This is a hybrid role with 3 days per week on site.

• Develop and manage data pipelines, including ingestion and orchestration.
• Design and model efficient database schemas.
• Integrate and enrich data from multiple sources, ensuring quality and consistency.
• Build and maintain ETL processes (e.g., using NiFi).
• Maintain and enhance existing data architecture and storage systems.
• Troubleshoot and resolve issues with integrated data.
• Implement strong data security measures.
• Support Scrum teams in breaking down user requests into tasks.
• Write clean, secure, test-driven, and reusable code.
• Monitor and optimize data system performance.

• Apache Kafka.
• Apache NiFi.
• SQL and noSQL databases (e.g. MongoDB).
• ETL processing languages such as Groovy, Python or Java.

The client would also like to see some of the below, but this is not essential:

• Grafana / Prometheus.
• Integration / debugging.
• Understanding complex system architectures.
• Technologically curious / Willing / Able to tactically upskill new technologies.

Our client is committed to providing a diverse and inclusive workplace and welcomes applications from all backgrounds.

Part-time opportunities/flexible working is available to suit individual needs.

Please note that the client has determined that the off-payroll working rules will apply to this assignment and therefore this contract will be run through an Umbrella Company. Income tax and primary national insurance contributions will be deducted at source from any payments made to the intermediary.

RECOMMEND A FRIEND: If you have professional friends/colleagues who would be interested in one of our roles and our excellent levels of service too, we'd like to recognise your recommendations with a 'thank you' of our own. For every friend you refer who then starts a role through Datasource either Contract or Permanent, we will send you £200 of Love to Shop Gift Vouchers & gift your friend £100 in Love to Shop Gift Vouchers as well!

You will be required to hold a minimum of DV clearance. If you do not hold an active DV clearance, please familiarise yourself with the vetting process before applying.

(c) Copyright Datasource Computer Employment Limited 2025.