Big Data Lead Engineer (Spark, Java, Hortonworks, Data Lake)

London (Central)
£600 - £700 per day
13 Oct 2016
21 Oct 2016
Currently seeking experienced and competent Lead Big Data Engineer with excellent Spark and Java skills to work for a Banking client site based in the City of London. It's an initial 6 month contract with likely extensions beyond. This is an exciting opportunity to work in a key role where a Group Data Lake is being created. You will be a lead engineer working with data scientists, big data engineers and application developers across the corporate division to design and build bespoke trading security platforms on top of both real-time streaming and batch data. What you'll be responsible for: - Leading and collaborating as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data & Fast Data applications - Building efficient storage for structured and unstructured data - Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm, Akka and Kafka on Hortonworks (HDP) platform - Utilising programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases like PostgreSQL and MongoDB - Utilising Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig, and Cassandra - Developing data-enabling software utilizing open source frameworks or projects such as Spring, Angular JS, SOLR, Drools, etc. - Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance This is a superb opportunity for an experienced Big Data Engineer to join a new Greenfield Data Lake project - working with the most cutting edge technologies and collaborating with like-minded engineers. If you are looking for your next challenging contract opportunity with a financial services client then please send your CV now for immediate review. This job was originally posted as

More jobs like this