View job on Handshake
Role : Big Data Engineer
Location: NEW YORK, NY (Remote)
Duration: 12 Months
· Good programming knowledge in Python, Scala & SQL.
· Experienced Big Data developer with 5+ years of experience in Apache Spark, Databricks, Kubernetes.
· Experienced in working with AWS components – Glue, Lambda, S3, DynamoDB, Athena, CloudWatch etc.
· Analytical and problem-solving skills, particularly for a big data environment
· Experienced in handling large scale Developments & deployments.
· Good knowledge in OAuth application or authentications.
· Developing Modern Data Warehouse solutions using Databricks and AWS.
· Experienced in Databricks CICD or CICD in general (Preferred – Concourse).