Senior Data Engineer

  • The Walt Disney Company
  • New York, NY, USA
  • Jun 14, 2018
Full-time Big Data Business Analytics Data Analysis Data Science Data Warehouse Digital Media Kafka Machine Learning Python Spark

Job Description

BAMTECH Media is a place for the creative and the bold. We’re seeking talent across disciplines to join our team. Whether New York City, San Francisco, Manchester or Amsterdam we provide opportunities to elevate your career and transform an industry.

BAMTECH software engineers develop premium digital media products for Major League Baseball and our partners. The products we build, such as MLB.TV, NHL.TV, HBO NOW and PlayStation Vue are paving the way for the next-generation media and sport technologies. BAMTECH engineering is headquartered in the Chelsea area of New York, NY with an office in the SoMo area of San Francisco, CA and team members based around the world.

If you are interested in joining BAMTECH in the pursuit of not only crafting new media products but enjoying the products you build, we are interested in hearing from you.

At BAMTECH data is central to measuring all aspects of the business, and critical to its operations and growth. The data engineering team is responsible for collecting, analyzing and distributing data using public cloud and open source technologies and offers transparency into customer behavior and business performance.

Responsibilities

  • Collaborate with product teams, data analysts and data scientists to design and build data-forward solutions
  • Build and deploy streaming and batch data pipelines capable of processing and storing petabytes of data quickly and reliably
  • Integrate with a variety of data metric providers ranging from advertising, web analytics, and consumer devices
  • Build and maintain dimensional data warehouses in support of business intelligence tools
  • Develop data catalogs and data validations to ensure clarity and correctness of key business metrics
  • Drive and maintain a culture of quality, innovation and experimentation

Basic Qualifications

  • 3-5 years of experience developing in object orient Python
  • Engineering big-data solutions using technologies like EMR, S3, Spark
  • Loading and querying cloud-hosted databases such as Redshift and Snowflake
  • Building data pipelines using Kafka, Spark, Flink, or Samza

Preferred Qualifications

  • Familiarity with binary data serialization formats such as Parquet, Avro, and Thrift
  • Experience deploying data notebook and analytic environments such as Jupyter and Databricks
  • Knowledge of the Python data ecosystem using pandas and numpy
  • Experience building and deploying ML pipelines: training models, feature development, regression testing
  • Experience with graph-based data workflows using Apache Airflow

About BAMTECH Media

BAMTECH is a streaming technology joint venture between The Walt Disney Company, Major League Baseball Advanced Media, and the National Hockey League. BAMTECH handles streaming for numerous partners, some of which include, HBO, MLB, NHL, Eurosport, ESPN, and World Wrestling Entertainment.

Fans demand access to content on their own terms on any device, anytime, anywhere. We are those fans. As a result, the BAMTECH Media team helped pioneer live event streaming over the Internet in 2002 for Major League Baseball. The passion to improve that experience led to many impressive firsts: the first 720p or “HD Ready” stream, the consecutive record for concurrent streams and the first stream in 8K ultra HD. Today, BAMTECH has a proven, scalable platform that powers direct-to-consumer applications for leading entertainment brands; and is now a major player in sports and eSports rights acquisition.

About The Walt Disney Company

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: media networks, parks and resorts, studio entertainment, consumer products and interactive media. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with BAMTECH, LLC, which is part of a business segment we call BAMTECH Media.

BAMTECH, LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a rapidly changing world.

Job ID

564060BR