Senior Data Engineer ( Spark/Python/Kafka )

Venturi Limited
60000.00 - 90000.00 GBP Annual
13 Jan 2021
17 Jan 2021
Contract Type
Full Time

Senior Data Engineer ( Spark/Python/Kafka )


??60-90k DOE

Senior Data Engineer ( Spark/Python/Kafka ) is required to join a leading Global Data Consultancy to provide end-to-end, full stack expertise, from strategy to design to build.

This consultancy works with clients across Media, Publishing, Marketing and Retail to set up their data: enabling more intelligent, faster decision-making and improved overall performance.

Their clients range from industry leading organisations to innovative start-ups and scale-ups, solving some of their hardest problems and adding directly to their bottom line.

The Senior Data Engineer ( Spark/Python/Kafka ) will work collaboratively with a team of product managers, data analysts, architects, engineers, governance specialists and operation experts to deliver high quality data outcomes. You will do this via modern data sourcing, integration and modelling techniques, working as part of a small tight knit team and often semi-Embedded within a client team as well (2-3 days with client, remaining time with team.)

Day to day responsibilities for the Senior Data Engineer ( Spark/Python/Kafka ) include:

  • Designing and implementing well designed code: easily scalable and readable
  • Design well structured tables that are structured for wide-spread use (ie, using Kiball Modelling)
  • Automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc)
  • Clearly communicate your work and provide confidence in order to drive change in a business
  • Understand complex requirements and break down into actionable chunks of work
  • Ability to coach/upskill other members of the team

Essential skills for the Senior Data Engineer ( Spark/Python/Kafka ) include:

  • Strong Python and SQL skills
  • They are a fairly tech agnostic outfit, but strong experience with AWS, GCP or Azure Cloud Tech would be essential
  • Commercial expertise in building end-to-end data products
  • Expertise in modern data tools including Spark and Kafka
  • Background in building out ETL processes
  • A desire and passion for building high quality products that drive change
  • A results-orientated mind-set with a passion for data and a keen eye for detail
  • Comfortable with some travel to clients (most sites are Central London based)
  • Able to work in fast-paced environments, rolling onto multiple projects if needed at any one time
  • Right to work in the UK

Desirable skills for the Senior Data Engineer ( Spark/Python/Kafka ) include:

  • Building effective CI/CD tools and processes
  • Effective Data Architecture
  • Experience with Azure, AWS, GCP, Snowflake or other modern cloud techs
  • Working with an Engineering mindset, (Ie Agile development, GIT, Jira)
  • Experience building applications with languages such as C sharp
  • Degree educated/training in a STEM subject

Benefits for the Senior Data Engineer ( Spark/Python/Kafka ) include:

  • Bonus (company performance) estimated between 7-14%
  • ??100 individual monthly work budget (to use on equipment, social drinks)
  • All client costs expensed
  • Exposure to world class clients, all of which are trying to solve large data problems
  • One of the best Learning and Development schemes in the business, serious investment and opportunity for fast progression.
  • Best training ground for CDO's of the future, lunch and learn clubs and certifications
  • 25 days holiday plus bank holidays, flexible approach to personal leave plus no blanket policy for working hours
  • Pension scheme, life and critical illness cover plus a medical plan
  • High impact in your role, many members of the consultancy can claim credit for saving millions for their clients
  • Very limited hierarchy and chance to shape the business

If you would like to apply for the above Senior Data Engineer ( Spark/Python/Kafka ) position, please select apply using your most recent CV.

Keywords: Senior Data Engineer, AWS, GCP, Azure, Python, Spark, Kafka, ETL, Data Engineer, Amazon Web Services, Google Cloud Platform, Microsoft Azure, SQL, Consultancy, Data

Similar jobs

More searches like this

Similar jobs