IEOR - Designing a More Efficient World

Big data Engineer at Soothsayer Analytics

View job on Handshake

Employer: Soothsayer Analytics

Expires: 09/01/2020

Soothsayer is seeking Big data Engineer who has an interest in solving challenging ML / AI problems in the Big data Environment. Freshers need not apply for this role, apply for this role, only if have hands on industry experience in Big data.Job Description:Solve cutting edge, challenging problems working alongside a great team of world class data scientists and analytics expertsHaving a passion for solving interesting and challenging big data problemsCommunicate results to scientific, business, and stakeholdersCollaborate with other engineers, data scientistsEducation and Experience:PhD in computer science, Physics, Statistics, applied Mathematics, or other quantitative/ Computational discipline or Master’s with over 2 year of real time relevant real-time Industry experience as a Big data Engineer is a MUST.Experience in architecting Big Data infrastructure and building end-to-end pipelines in Cloudera Distribution Hadoop.Familiarity with data ingestion from structured data sources such as SAP, excel files and unstructured data such as pdf, images.Expertise in data storage components in Hadoop such as HDFS, Hive and HBASEExperience implementing search solutionsFamiliarity with Lucene/SOLR or other enterprise search/indexing technologiesFamiliarity with Graph databases such as Janus graphsFamiliar with DevOps experience (CI/CD) and best practices.Experience in unit testing, integration testing and stress testingSetting up data authentication and role-based authorization protocols with Apache Kerberos and Apache Sentry.Knowledge / experience using AG web methods for orchestrationExcellent data presentation skillsTHIS IS NOT AN INTERNSHIP POSITION AND IMMEDIATE NEED. MINIMUM QUALIFICATION IS PhD or Master’s with at least 2 year of real-time relevant Industry experience as a Big data Engineer.PLEASE READ THE MINIMUM QUALIFICATIONS BEFORE APPLYING.Covid-19 update: Currently work remotely, please be ready to start working from our office in Detroit, from August 1, 2020.