Sr. Big Data Engineer

Sr. Big Data Engineer

San Jose, CA 2016-11-01 - –

Adobe Adobe

The Challenge:

As a Sr. Big Data Engineer within IDS you will be working in a fast-paced technical environment with other data engineers, product managers, consultants, and Business Users (Customers) . It will be your responsibility to bring in, share, and apply your data modeling/design and ETL expertise and creativity to respond quickly to newly emerging customer requirements. You will be sharing your findings openly in a team environment at Adobe. You must possess outstanding communication skills and be willing to plan, develop and deliver within the Hadoop environments.

What you’ll do

o Build and scale a data platform that enables reliable, trustworthy, and approachable data delivered in SDMs to all Adobe solutions and to thousands of Data Scientists.

o Contribute to software that will deliver, model, curate, data that powers the core.

o Solve some of our business’ most critical technical challenges.

o Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

o Implementing ETL processes

o Represent Architecture team to broader business and to external customers.

o Monitoring performance and advising any necessary infrastructure changes

o Bring thought leadership and direction to the team in picking the correct tool, technology.

o Mentor junior engineers

o Build and develop critical parts of the data platform and deliver to production

o Track record proving ability to be a self-starter, independent engineer who demonstrates ownership of code

o Ability to translate high level requirements to actionable tasks/deliverables

What you need to succeed

o Well versed in data design patterns – Understanding and practical experience with Lamda, Kappa architectures, Micro services

o Data open source technologies – Spark, Hadoop stack

o Experience with Cloudera/MapR/Hortonworks

o Experience building data pipelines from ingeGood understanding of Lambda Architecture, along with its advantages and drawbacks

o Proficient understanding of distributed computing principles

o Experience with NoSQL databases, such as HBase, Cassandra, MongoDB

o Proficiency with Hadoop ecosystem (querying tools, such as Pig, Hive, and Impala)

o DevOps experience handling and solving large Solr and Cassandra Cluster issues on a production environment

o Experience with various messaging systems, such as Kafka or RabbitMQ

At Adobe, you will be immersed in an exceptional work environment that is recognized throughout the world on Best Companies lists . You will also be surrounded by colleagues who are committed to helping each other grow through our unique Check-In approach where ongoing feedback flows freely.
If you’re looking to grow your career, Adobe’s the place for you. Discover what our employees are saying about their career experiences through the Adobe Life magazine .
Adobe is an equal opportunity employer. We welcome and encourage diversity in the workplace regardless of race, gender, sexual orientation, gender identity, disability or veteran status.

To apply for this job please visit tinyurl.com.