This job board retrieves part of its jobs from: Toronto Jobs | Emplois Montréal | IT Jobs Canada

Bringing you the hottest job offers in California

To post a job, login or create an account |  Post a Job

Senior Cloud Data Engineer

Openmind Technologies

This is a Contract position in San Jose, CA posted October 30, 2019.

Our client is looking for a Cloud Data Engineer, you should be an expert with data warehousing technical components (e.g., ETL, ELT, Cloud Databases and Reporting), infrastructure (e.g.

hardware and software) and their integration.

You should have deep understanding of the architecture for enterprise level data lake solutions using multiple platforms (RDBMS, Columnar, Cloud).

You should be an expert in the design, creation, management, and business use of extremely large datasets.

You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions.

The individual is expected to be able to build efficient, flexible, extensible, and scalable ETL and reporting solutions.

Responsibilities: Design and develop framework to automate data ingestion and integration of structured data from a wide variety of enterprise data sources, at scale.

Design and develop data pipeline components and integrate them with ETL Platforms.

Design data quality monitoring and automated data cleaning.

Assist the business liaison and ETL function with data related issues such as assessing data quality, data consolidation, evaluating existing data sources, etc.

Experience with handling large data infrastructure platform and driving stability through automated monitoring, alerting, and actions.

Experience developing for, configuring, and supporting Cloud computing solutions Requirements: Experience with building scalable and reliable data pipelines using Data engine technologies like APIs, AWS Redshift, Snowflake, Talend.

8 years of experience with and detailed knowledge of AWS based data warehouse technical architectures, data modeling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding.

4 years experience designing and developing complex ETL/ELT programs with Python, Visual ETL Tools etc 3 years experience developing complex SQL Experience using Cloud Storage and computing technologies such as RedShift, Snowflake 3 years experience programming in Python 2 years experience with Bitbucket 2 years experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues 2 years implementing and programming data ingestion and ETL programs with large datasets (Terabytes sized analytical environment) Experience with API based integration from multiple SaaS data sources Experience developing and implementing streaming data ingestion solutions Experience in Agile methodology (2 years) WE ARE AN EQUAL OPPORTUNITY EMPLOYER
– provided by Dice