Big Data Lead Engineer (Spark, Java, Hortonworks, Data Lake)

Recruiter
Venturi
Location
London (Central)
Salary
£600 - £700 per day
Posted
13 Oct 2016
Closes
21 Oct 2016
Sector
IT
Currently seeking experienced and competent Lead Big Data Engineer with excellent Spark and Java skills to work for a Banking client site based in the City of London. It's an initial 6 month contract with likely extensions beyond. This is an exciting opportunity to work in a key role where a Group Data Lake is being created. You will be a lead engineer working with data scientists, big data engineers and application developers across the corporate division to design and build bespoke trading security platforms on top of both real-time streaming and batch data. What you'll be responsible for: - Leading and collaborating as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data & Fast Data applications - Building efficient storage for structured and unstructured data - Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm, Akka and Kafka on Hortonworks (HDP) platform - Utilising programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases like PostgreSQL and MongoDB - Utilising Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig, and Cassandra - Developing data-enabling software utilizing open source frameworks or projects such as Spring, Angular JS, SOLR, Drools, etc. - Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance This is a superb opportunity for an experienced Big Data Engineer to join a new Greenfield Data Lake project - working with the most cutting edge technologies and collaborating with like-minded engineers. If you are looking for your next challenging contract opportunity with a financial services client then please send your CV now for immediate review. This job was originally posted as www.cwjobs.co.uk/job/66885624

More jobs like this