Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

YWROa2FZelA0U0NKd09TZ0ZSMDhJNzRuOVE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

OrthoVirginia

Pediatric Orthopedic Surgeon Job at OrthoVirginia

 ...Pediatric Orthopedic Surgeon with Partnership Track Opportunity in Richmond, VA OrthoVirginia, a physician owned/led group with over 40 clinical locations across Virginia, is seeking a Pediatric Orthopedic Surgeon to join our busy multidisciplinary practice in the... 

Wakefern Food Corp.

SAP SD/OTC Lead Job at Wakefern Food Corp.

 ...portfolio of services, including innovative technology, private label development, and best-in-class procurement practices. The SAP OTC / SD Lead is responsible for the design, implementation, and support of the SAP Order-to-Cash (OTC) process, with a specialized focus... 

Huron

Consulting Manager, Healthcare Supply Chain Job at Huron

 ...leadership in the markets they serve. We help healthcare organizations build innovation...  ...effective and timely delivery of medical supplies and equipment. Utilize data analytics...  ...drive continuous improvement in supply chain operations, enhancing overall efficiency... 

Aramark

Cook - Dr. Pepper Job at Aramark

Job Description Do you love to cook? Are you passionate about food? As a Cook on our team, youll help bring recipes to life while being able to flex your creativity! Surrounded by fresh ingredients and the best equipment, youll be immersed in a world that goes beyond...

IU Health Medical Group - Indiana University Health

Radiology - Physician Job at IU Health Medical Group - Indiana University Health

 ...Highlights ~100%Neuroradiology CT and MRI ~ Salary and benefits are highly competitive ~ Opportunities for moonlighting (pay-per-click) for additional pay ~24/7 reading room clinical administrative assistant support for phone calls and communication...