Data Engineer datawarehouse, ETL -

Cardiff (Caerdydd)
£45000 - £60000 per annum
13 Oct 2016
21 Oct 2016
Contract Type
Data Engineer datawarehouse, ETL - Cardiff up to £60,000 excellent benefits Working with an organisation recognised continually as one of the top 50 to work for by The Sunday Times Top 100 Companies, we are currently sourcing for a Data Engineer to join the team. The successful candidate will join a rapidly growing international organisation that specialise in information and have over 80,000 customers worldwide the key to their success has been their staff centred approach and great working environment. This is an interesting and varied position where the successful candidate will be working with customers, engineers, product managers and data analysts to understand data needs. Taking responsibility for; The design, build and launch of new data models The design, build and launch new data ETL and ELT processes. Creating architectural workflows, diagrams and specification documents to help define platform features and functionality Building data pipelines using HDFS, Pig, Hive, HBase, Presto, Spark Creating functioning ETL prototypes to address quickly changing business needs Performing data profiling, complex sampling, statistical testing Interrogating a Data Lake and Oracle RDBMS to provide data-sets for data analysts Supporting existing production processes in operation In terms of experience, our successful candidate will ideally have any experience with; Data warehousing Working with a MPP system Designing and building autonomous data pipelines within the Hadoop ecosystem using Working within a unix environment with the ability to perform basic database and system administration tasks Also, any hands on knowledge of databases and best engineering practices(include handling and logging errors, system monitoring and building human-fault-tolerant pipelines) as well as experience of data cleaning processes including data profiling would be highly beneficial. Data Engineer Job Summary - Fulltime - Normal working hours (flexible) Salary up to £60,000 DOE 25 days holiday Life assurance Pension scheme Childcare vouchers Private healthcare Company mobile phone Located in Cardiff This is an excellent opportunity for the right candidate; for more details please apply for an initial call back regarding the role / your experience or call Jonathan Edwards on 02920 252500 for a confidential chat and more information on the role. "The services advertised by IntaPeople are those of an Employment Agency and an Employment Business" This job was originally posted as