Data Engineer

Our client is supporting the National Security industry in development of mission critical technical solutions that focus on data services.

For this role You will need experience within the National Security space to be considered!

Working Patterns and location – The role is based full time on site in London

As our next Data Engineer, you’ll be managing and developing data pipelines that transform raw data into valuable insights for our clients National Security customers, enabling downstream analytics and reporting. You’ll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets.

• Data pipeline development - Data ingestion and pipeline orchestration design and tooling.
• Database schema design / database modelling
• Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality.
• ETL processing design and coding - Extract transform and load processing such as NiFI.
• Create code that is open by default and easy for others to reuse
• Maintain and develop existing architectural components including Data Ingest and Data Stores
• Work as part of an operational team investigating and diagnosing problem identified with integrated (enriched) data.
• Explain the difference between user needs and the desires of the user
• Data security - Implementing data security measures to protect sensitive information.
• Be able to help the scrum team decompose user requests and key results into epics and stories.
• Writing clean, secure code following a test-driven approach
• Create code that is open by default and easy for others to reuse
• Monitor and maintain - Monitor data systems for performance issues and make any necessary updates.

• ETL processing languages such as Python
• Apache Spark / NiFi / Kafka
• Relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
• AWS and data-related services
• Palantir Foundry

Our client is committed to a policy of Equal Opportunity, Diversity and Inclusion. Their working environment is friendly, innovative and inclusive.  They can accommodate flexible working arrangements and support a diverse work-force and those with additional needs.

Please note that the client has determined that the off-payroll working rules will apply to this assignment and therefore this contract will be run through an Umbrella Company. Income tax and primary national insurance contributions will be deducted at source from any payments made to the intermediary.

RECOMMEND A FRIEND: If you have professional friends/colleagues who would be interested in one of our roles and our excellent levels of service too, we'd like to recognise your recommendations with a 'thank you' of our own. For every friend you refer who then starts a role through Datasource either Contract or Permanent, we will send you £200 of Love to Shop Gift Vouchers & gift your friend £100 in Love to Shop Gift Vouchers as well!

You will be required to hold a minimum of DV Clearance. If you do not hold an active DV clearance, please familiarise yourself with the vetting process before applying.

(c) Copyright Datasource Computer Employment Limited 2025.