Hadoop Solutions Architect

Experian EXPERIAN

Job Description – Hadoop Solutions Architect (161932)
Experian is an Equal Opportunity Employer

Hadoop Solutions Architect – Job Number: 161932

Description
Responsibilities

  • Work with business units globally to accelerate development of Hadoop and Spark based solutions upon the Experian Data Fabric
  • Design high throughput and streaming data pipelines using Experian Lambda Architecture; Internal bulk sources to include server logs, file uploads, database logs, relational sources and CDC; streaming sources to include web sockets, HTTP client callbacks, and kafka events
  • Work with business and applications teams to identify policies relative to data privacy, confidentiality, archiving, retention, etc. and design solution components to operationalize the data the policies
  • Design and build data provisioning components to deliver data for operational analytics as well as research purposes
  • Design ultra-low latency micro services to serve data from the State Container within 10 milliseconds
  • Build data pipelines using HDFS, MapReduce, Spark, Storm, Kafka and emerging compute frameworks
  • Design Parquet structures for Analytics Containers to serve business intelligence and analytics use cases
  • Design schema and streaming pipelines for real-time stores such as Cassandra and Hbase

Qualifications
Qualifications

  • 8+ years hands-on senior developer/architect
  • 3+ years experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, Cassandra, HBase, Hive, Flume, Sqoop, Spark, Kafka, etc.
  • 1+ year experience working with native MapReduce and/or spark
  • 5+ years Java development background
  • 5+ years data engineering/ETL development experience working with data at scale
  • Desired – Bachelor's degree in Computer Science, Engineering or related discipline
  • Desired – experience with metadata based or rules driven ETL layer
  • Desired – Experience with development of generic data ingestion and transformation framework

Job : Information Technology & Systems
Primary Location : United States-California-Costa Mesa

Schedule : Full-time
Job Posting : 09/20/2016, 3:54:11 PM
Organization : GTS – Old

Reasonable Accommodation Experian provides reasonable accommodation so that qualified applicants with a disability may participate in the selection process. Please advise us of any accommodations you request
in order to express interest in a position by e-mailing: talentacquisitonops@experian.com
or 714-830-5022. Please state your request for assistance in your message. Only reasonable accommodation requests related to applying for a specific position within Experian will be reviewed at the e-mail address and phone number supplied. Thank you for considering a career with Experian.

To apply for this job please visit tinyurl.com.