Data Engineer

Ref: ZR_6523_JOB  ·  Posted on 13 October 2021

Introduction

As a Data Engineer you are someone who is passionate about using data to solve real-world problems, and you will have the satisfaction of seeing the direct results of your work. You will be responsible for interpreting large volumes of data and maintaining pipelines to support creation of the digital solutions. You will apply a strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting solutions for data scientists that enable them to do their jobs.

You will join an expanding and diverse team where you will be given the opportunity to gain a wide range of experience, develop your skills and have lots of fun in the process.

Key responsibilities
  • Create and maintain optimal data architectures and pipelines.
  • Assemble large, complex data sets that meet functional and non-functional business requirements.
  • Discover opportunities to acquire new data from other systems.
  • Develop and improve data set processes for data modeling, mining, and production.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Implement data pipelines using software engineering and DevOps best practices including: automated testing, version control, and CI/CD in a cloud-based environment
  • Recommend and implement ways to improve data reliability, efficiency, and quality.
  • Work with Data Scientists to build analytics tools that utilize the data pipeline to provide actionable insights into asset management, operational efficiency and other key business performance metrics.
  • Collaborate with stakeholders including the Product owner, data science, and design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing the products that help business achieving their goals.
Skills & experience
  • Degree or equivalent in a relevant subject e.g. Computer Science, Information Systems or related Technical Discipline.
  • Deep knowledge of SQL, Cloud based data pipelines, architectures and data sets.
  • Experience working with distributed data processing frameworks such as Spark in cloud-based environments
  • Experience working with large data sets, data pipeline and workflow management tools, Azure cloud services, REST APIs and stream-processing systems.
  • Experience working in an agile environment or organizations with an agile culture.
  • A professional attitude and an ability to think outside of the box to solve complex challenges.
  • Background in programming in Python, Scala, or Java (Python preferred)
  • Good written and verbal communication skills along with strong desire to work in cross-functional teams.

Our client is committed to providing a diverse and inclusive workplace and welcomes applications from all backgrounds.

Part-time opportunities/flexible working is available to suit individual needs.

Apply for role
Data Engineering Contract DEVOPS Stakeholder

Refer your friend: We want to give you a Netflix or Amazon Prime subscription and £250 Love2Shop vouchers!

Refer your friend
Refer your friend:
Contact us

Let's connect and work together

Start the conversation

Submit CV  ·  Submit Vacancy