Data Engineer - Hadoop/Spark

  • The Walt Disney Company
  • Burbank, CA, United States
  • Feb 02, 2018
Full-time Data Analysis

Job Description

  • Design, build and implement Hadoop/Spark batch jobs
  • Build and optimize performance of Spark, Kafka, Cassandra, ELK, and whatever else makes sense for real-time pipelines
  • Design and architect high quality data-lake, data-warehouse, and data-marts data models
  • Enable and implement Data Science workflows and advanced machine learning algorithms
  • Tune and improve search relevancy using ElasticSearch
  • Build and maintain data pipelines orchestration
  • Develop and cultivate expertise in current and new technologies and tools
  • Collaborate with other software engineers and cross-functional teams
  • Share new ideas with a larger community of highly experienced technologists
  • Ability to prioritize tasks, requirements, and complexity
  • Real passion for coding (If you have a Github profile, that’s awesome! We would love to check it out!)
  • Understanding of distributed systems and distributed computation
  • Working knowledge in at least 2 of: Scala, Java, Python, or Go-Lang
  • Working knowledge of data Apache Spark ecosystem technologies like Spark, Kafka, Hive, Presto, Oozie, Pig, Hue, Zeppelin
  • Demonstrated working knowledge of data modeling
  • Unit, Integration, and Load testing
  • Developing REST APIs
  • Git
  • Ant, Maven, SBT, and/or Gradle
  • Unix/Linux
  • Docker containers building and deployment
  • Excellent communication and collaboration skills
  • Ability to prioritize tasks, requirements, and complexity
  • Kubernetes knowledge
  • Apache Spark MLlib
  • Apache Spark GraphX
  • R
  • Amazon AWS or other cloud services
  • Jenkins
  • BS in Computer Science or related field with 2+ years of experience
This position is a legal entity of The Walt Disney Studios, an equal opportunity employer.
Movies Anywhere seeks a Data Engineer to join a team of seasoned, dedicated technologists solving a range of interesting problems in innovative ways in an exciting and dynamic industry. We are looking for a self-starting engineer who wants to shape the next generation of video consumption applications. We’re a casual shop that values passion, community involvement and code that stands out. If you are interested, we’d love to hear from you.

The Data Engineer will work in a small team of multi-disciplined technologists developing insights to drive the Business, Marketing and Finance decisions for our next-generation video delivery and consumption platform. We expect you to be up to date on the happening in the data community, passionate about what you do, and connected to the open source community. You will participate in overall system design, developing multi-tiered data solutions emphasizing reuse and good design patterns.
This position is a legal entity of The Walt Disney Studios, an equal opportunity employer.

Job ID