Sr Data Engineer (Big Data)

disneystudios The Walt Disney Studios

Work on all phases of projects from design to implementation including specifications, development, testing, rollout, documentation and, if applicable, turnover to the Maintenance Engineering and Operations Team.

Work within state of the art engineering practices (i.e. SCRUM, unit testing, design review, code reviews, continuous integration, etc.).

Partners with team lead to identify technical requirements and alternatives to accomplish project.

Providing accurate estimates for project development and implementation. Work with management to meet those estimates.

Participates in design, code, test, maintenance, enhance and decommission phases throughout software life cycle to contribute technical expertise and to identify issues.

Presents status, plan and issues/risks at daily stand-ups.

Mitigates risk for the project, team and company.

Work with the Architecture team in defining software and infrastructure technical solutions.

Serve as a mentor and advisor to team members.

Ensures knowledge transfer to team members within and outside of immediate group.

Participate in interviewing technical candidates and provide feedback.

Iteratively improves projects with agile delivery practices.

8+ years of full software development lifecycle experience

5+ years of experience developing web applications

5+ years of Object-Oriented analysis, design and development experience

5+ years of experience in a data oriented role

Strong Java 1.7+ Experience

Strong Linux Experience

Significant exposure to and demonstrated proficiency in all aspects of programming and analysis including design patterns, hardware and software requirements, systems requirements and deployment protocols

Agile experience using Scrum

Experience with open source technologies

Experience with unit testing & test driven development (TDD)

BS in computer science, engineering, mathematics or physical sciences

Experience with the Hadoop batch processing framework and map reduce design patterns

Experience with a widely used RDBMS’ and SQL

Experience with at least one columnar NoSQL solution

Experience developing, maintaining, and innovating large scale, consumer facing web applications

Experience working in a large big data enterprise organization

Experience with Apache Spark including Spark Streaming

Experience with LinkedIn’s Azkaban, Apache Closure

Experience with Enterprise Integration Patterns and Apache Camel

Experience with social, mobile, cloud/SaaS integrations

API level experience with Youtube, Twitter and Facebook

Experience creating robust and reliable data pipelines

Familiar with the development challenges inherent with highly scalable and available web applications.

Experience with various, modern web frameworks

Experience with PostgreSQL RDBMS

Experience with Apache hBase

Experience with Apache Hive and/or Apache Crunch

Experience with Apache Avro.

Experience with Pentaho Weka or Apache Mahout

Experience with the uses of various NoSQL solutions including hBase, MongoDB, Neo4j

Operational experience with large software systems

Experience with Amazon EC2 and EMR

Schema and/or Cube design experience

Experience with a visualization tools such as D3.js, Tableau, MicroStrategy

Experience with ETL tools such as Pentaho Kettle, Informatica, Talend, OpenRefine

Exposure to statistics, machine learning and natural language processing applications

Exposure to security, PII and PCI compliance issues

Exposure to R, Python, Julia, Haskell BS or MS in computer science, engineering, mathematics or physical sciences

StudiosTech This position is with Walt Disney Pictures.

#StudiosDataServices

Keyword: StudiosTech

The Walt Disney Company is world-class entertainment and technological leader. Walt’s passion was to continuously envision new ways to move audiences around the world—a passion that remains our touchstone in an enterprise that stretches from theme parks, resorts and a cruise line to sports, news, movies and a variety of other businesses. Uniting each endeavor is a commitment to creating and delivering unforgettable experiences — and we’re constantly looking for new ways to enhance these exciting experiences. Bring your individual talents here and discover for yourself why a career with Disney is the opportunity you’ve been looking for.

The Walt Disney Studios encompasses the creation, production, promotion, sales, acquisition and domestic and international distribution of live-action and animated motion pictures, DVD releases, live stage plays, and music and soundtrack recordings.

The Senior Data Engineer will work with a mid-size, close-knit team to design, implement, analyze and maintain models, information systems and analytical tools to assist in a variety of functions to deliver business solutions technology products and services to the Walt Disney Studios. This position is with Walt Disney Pictures.

#StudiosDataServices

Keyword: StudiosTech

To apply for this job please visit tinyurl.com.