Big Data Hadoop and Teradata A...

Big Data Hadoop and Teradata Administrator

North Charleston, SC 29418 2016-10-28 - –

Job Description:
Big Data Hadoop and Teradata Administrator

  • Provide technical and development support to the government client to build and maintain a modernized Enterprise Data Warehouse (EDW) by expanding the current on-premises Hadoop cluster to accommodate an increased volume of data flowing into the enterprise data warehouse
  • Perform data formatting involves cleaning up the data.
  • Assign schemas and create HIVE tables
  • Apply formats and structure to support fast retrieval of data, user analytics and analysis
  • Assess the suitability and quality of candidate data sets for the Data Lake and the EDW
  • Design and prepare technical specifications and guidelines.
  • Act as self-starter with the ability to take on complex projects and analyses independently
  • Knowledge of SLES 11 OS.
  • DOD Secret clearance and 8570 certification required.

Description of Work:

  • Responsible for implementation and ongoing administration of Hadoop infrastructure.
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
  • Working with data delivery, development teams, and Information Assurance to setup new Hadoop users and policies. This includes setting up new LDAP users, validating and troubleshooting Ranger policies, testing access for the users, and troubleshooting a secured Hadoop environment using Kerberos, Knox, and Ranger.
  • Familiarity of Hadoop cluster maintenance with Ambari.
  • Performance tuning of Hadoop.
  • Monitor Hadoop cluster job performance, capacity, connectivity and security.
  • Manage and review Hadoop log files.
  • File system management and monitoring.
  • HDFS support and maintenance.
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
  • Point of contact for vendor for coordinating access and schedule for cluster and/or node maintenance and upgrades.
  • Responsible for maintaining documentation of Hadoop system architecture and processes.
  • Software installation and configuration.
  • Hive performance monitoring and tuning.
  • General operational expertise such as good troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.

Teradata admin capabilities and responsibilities:

  • Responsibility for 24×7 normal DBA functionality
  • Performance tuning, statistics collection, health analysis, analyzing explain plans and table statistics.
  • Capacity planning and space allocation for database and tables.
  • Point of contact for vendor for coordinating access and schedule for cluster and/or node maintenance and upgrades.
  • Partition management and health
  • Monitoring of the data loading and data mart updating
  • Familiarity with BTEQ, Fastexport, Multiload, and Fastload
  • Familiarity with Viewpoint and its capabilities for monitoring Teradata systems, including administration of Data Labs
  • Responsible for maintaining documentation of TDW system architecture and processes.
  • Software installation and configuration.

Basic Qualifications:

  • Must be a US Citizen
  • Bachelors or Master’s Degree in technical or business discipline or related experience required. BS in Computer Science, Math or Engineering desired and 7 to 9 years of related work experience
  • 4+ years of proven experience in a range of big data architectures and frameworks including Hadoop ecosystem, Java MapReduce, Pig, Hive, Spark, Impala etc..
  • 5 years of proven experience working with, processing and managing large data sets (multi TB scale).
  • Proven experience in ETL (Syncsort DMX-h, Ab Initio, IBM – InfoSphere Data Replication, etc.), mainframe skills, JCL
  • Knowledge of SLES 11 OS.
  • DOD Secret clearance and 8570 certification required.

Preferred Qualifications:

  • Candidates with these skills will be given preferential consideration.
  • Experience with Hadoop and TeraData Administration.
  • Experience with Linux Administration.
  • Experience in coding shell scripting in Python.
  • Experience in Big Data Storage and File System Design.
  • Experience in performing troubleshooting procedures and designing resolution scripts
  • Experience with Mainframe development including Java Batch development, Architectural Design/Analysis and Database development.
  • Experience in analytic programming, data discovery, querying databases/data warehouses and data analysis.
  • Experience in data ingestion technologies with reference to relational databases (i.e. DB2, Oracle, SQL)
  • Experience with advanced SQL query writing and data retrieval using “Big Data” Analytics.
  • Experience with enterprise scale application architectures.
  • Proven ability to work with senior technical managers and staff to provide expert-level support for the installation, maintenance, upgrading, and administration of full-featured database management systems

Other:

  • Knowledge and experience with application integration, thorough understanding of complex network topologies, solid understanding of system security & risk management
  • Knowledge of Informatica, Syncsort DMX-h, Ab Initio
  • Knowledge of a variety of technical tools, methodologies, and architectures as used in the SSA computing environment
  • Knowledge of leading-edge technologies, new methodologies, and best practices applicable to work performed.
  • Knowledge of SSA’s Enterprise Architecture

Company Description :
CACI employs a diverse range of talent to create an environment that fuels innovation and fosters continuous improvement and success. Join CACI, where you will have the opportunity to make an immediate impact by providing information solutions and services in support of national security missions and government transformation for Intelligence, Defense, and Federal Civilian customers. A Fortune magazine World's Most Admired Company in the IT Services industry, CACI is a member of the Fortune 1000 Largest Companies, the Russell 2000 Index, and the S&P SmallCap600 Index. CACI provides dynamic careers for over 20,000 employees worldwide.

CACI is an Equal Opportunity Employer – Females/Minorities/Protected Veterans/Individuals with Disabilities.

To apply for this job please visit tinyurl.com.