Principal Data Engineer

  • The Walt Disney Company
  • Glendale, CA, USA
  • Aug 02, 2019
Full-time Data Engineering Data Science Data Visualization Data Warehousing Hive Kafka Spark SQL Tableau Teradata

Job Description

The Walt Disney Studios is comprised of large team of creative professionals who produce and acquire live-action and animated motion pictures, direct-to-video content, television and serial properties, musical recordings and live stage plays that tell memorable, life changing stories. Few media and entertainment companies can rival the brands we have the honor of bringing to the world.

Responsibilities :

  • Architect and lead the implementation of distributed systems solutions to data engineering problems.
  • Partner with management in hiring and team building
  • Analyze business needs, and design and build high-quality solutions
  • Balance resources, requirements, and complexity
  • Collaborate with customer representatives, product and project management teams
  • Evangelize technologies, solutions, and best practices
  • Contribute new ideas to a larger community of high-caliber professionals

Basic Qualifications :

We are looking for a seasoned, dynamic engineer who wants to shape the way that a major, fortune 100 entertainment company engages with data analytics. You have shipped millions of lines of code. You have lead teams, in a technical (and maybe managerial) role. You think naturally in terms of tradeoffs between flexibility and simplicity, between usability and security, between timeline, budget, and quality.

We are looking for the following in a candidate:

  • An educational background that has facilitated your technology career--surprise us!
  • 10+ years of professional software experience
  • Passion for building high-quality software and systems that deliver business value
  • Passion about system design, with interests and experience across the architecture from virtual machine and language internals to distributed systems performance and analysis
  • Fluency with the fundamentals of algorithms and data structures

You should have some mastery of:

  • Spark, Hive, Databricks, and other big data technologies
  • SQL and related tools
  • Docker and Kubernetes
  • The AWS environment and toolset
  • A range of JVM/CLR languages, as well as scripting/systems languages like Python
  • Distributed systems and API design
  • Testing practices (unit, integration, performance)
  • Revision control with git

Preferred Qualifications:

It would be great if you knew anything about:

  • Kafka and other streaming technologies
  • Dependency and build tools for continuous integration and deployment
  • Elastic Search, Kibana, or other aggregation and search tools
  • Teradata, Informatica, Snowflake, and other data warehouse solutions
  • Tableau, MicroStrategy, d3, and other data visualization tools

It would be cool if you have experience with or interest in:

  • Data science, statistics, machine learning and other applied mathematics
  • Data lake implementation and support
  • GraphQL
  • DynamoDB or RDS

 

Job ID

692612BR