Principal Data Engineer

Cardlytics Corporation

Cardlytics is seeking a Senior Principal Data Engineer (Hadoop/Apache Stack) with excellent technical qualifications and a passion for creating high performing and scalable data systems.

The Senior Principal Data Engineer is responsible for the design and coding of new applications, enhancing existing products, and implementing new technologies, paradigms, and practices to provide the best solutions to our customers. This includes technical design and development of Cardlytics current and future systems as part of a team of other data engineers and across other Engineering and business teams. The position reports to a Hadoop/Apache engineering team Technical Manager as part of a larger Data Engineering group; we want cross-pollinators that desire to contribute to the team as a whole, regardless of background.

Responsibilities:

  • Develop new applications and features within a Kanban Data-as-a-Service team providing data services via Hadoop and Apache stacks to Scrum software engineering, data science, analysts, product, management/executives, and other business teams
  • Build high performing and scalable data systems to support multiple internal and 3 rd party data pipelines and appx. 50 concurrent data scientists and analysts
  • Implement new technologies and practices to provide the best solutions to our customers
  • Ensure that our enterprise grade Apache systems are resilient, scalable, and secure
  • Develop and maintain solutions on our Apache stack environment (Java, Spark/Scala, Kafka, Elasticsearch, Drill, Kylin, etc.) on our Linux-based Hadoop environments (MapR distro, HBase, Hive, Yarn, Zookeeper, Oozie, Spyglass, etc.)
  • Work with business teams to create technical requirements and deliver within time and scope
  • Work with IT Operations and Prod Support to ensure solutions are releasable, maintainable, and scalable
  • Work with Risk & Compliance to ensure necessary logging/security is in place to comply with audits
  • Participate in POCs as requested for new related tech versions, toolsets, and solutions both built and bought to prove viability for given business cases
  • Liaison with contractors and vendors, both on and off shore, as required

Qualifications:

  • You may not be a “rock star” yet, but you’re at least on tour
  • Senior knowledge of Java, Spark, Scala, and Bash/Linux on a Hadoop stack is required
  • These are all big pluses: Kafka, Drill, Sqoop, Pig, Hive, HBase, Zookeeper, Nimbus, Kylin, Oozie, Python
  • These are all nice to haves: experience with relational and NoSQL, especially Vertica and/or MS SQL Server; AWS S3; Redis
  • You can follow and contribute engineering expertise to a detailed conversation about data science (models, scoring, R, Python, SAS, and statistical techniques)
  • Working knowledge of optimization, concurrency, scale-up vs scale-out, encryption, application- and process-level security, etc. in an Apache/Hadoop environment is a plus
  • You can follow and contribute to a detailed conversation about Web, REST, APIs, JSON, service buses, and other web developer speak
  • Testing (functional, WB, BB, performance, scale, and associated numerical analyses) skills are a must
  • Experience in the financial, marketing or advertising fields and familiarity with pricing models, audience and engagement data, etc. is a huge plus
  • Streaming experience and some knowledge of bottleneck/queue theory is a plus

Education, Training and Travel

  • Bachelor’s degree in Computer Science, MIS or related field or equivalent relevant experience
  • Travel: less than 10%

Communication and Cognitive Abilities

  • You express yourself and articulate your ideas clearly, thoroughly, and respectfully, listen the same way, and do both across the org chart without fear
  • Offer opinions and make decisions with limited information; ability to accept and manage risk and drive change
  • Ability to take abstract ideas, formulate an actionable strategy, and execute on time and on scope
  • Demonstrated ability to manage multiple, conflicting priorities
  • Fast-paced environment with short delivery times
  • Excellent verbal and written communication skills required
  • Self-starter ability to drive projects forward with limited oversight
  • Mentor and build junior employees on the team or who want to be on the team

About Cardlytics:
Cardlytics uses purchase-based intelligence to make marketing more relevant and measurable. We partner with more than 1,500 financial institutions – including Bank of America and PNC – to run their banking rewards programs that promote customer loyalty and deepen banking relationships. In turn, we have a secure view into where and when consumers are spending their money. We use these insights to help marketers identify, reach and influence likely buyers at scale, as well as measure the true sales impact of marketing campaigns. Headquartered in Atlanta, Cardlytics has offices in London, New York, Chicago and San Francisco. Cardlytics is one of the fastest growing U.S. companies ranked #88 on the 2015 Inc. 5000 and #25 on the Deloitte 2015 Technology Fast 500™. Learn more at www.cardlytics.com.

To apply for this job please visit tinyurl.com.