GCP Data Engineer

Hi,

Position: GCP Data Engineer

Location: Dearborn, MI

Duration: 12+ Months

Job Description:

Experience

•     Total IT Experience 5+ 

•     3+ years of experience as GCP Data Eng.

 

• Act as a subject matter expert in data engineering and GCP data technologies.
• Work with client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from the Google Cloud Platform.
• Work with Agile and DevOps techniques and implementation approaches in the delivery.
• Be required to showcase your GCP Data engineering experience when communicating with clients on their requirements, turning these into technical data solutions.
• Be required to build and deliver Data solutions using GCP products and offerings.

 

Skill

• In-depth understanding of Google's product technology and underlying architectures
• BigQuery – Warehouse/ data marts – Through understanding of Big Query internals to write efficient queries for ELT needs, creation of views/materialized views, creation of reusable store procedures etc.
• DataFlow (Apache Beam) – reusable Flex templates/ data processing frameworks using Java for both batch and stream needs.
• Pub/Sub, Kafka, Confluent Kafka – Real time streaming of database changes or events.
• Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture
• Strong knowledge of the Kafka Connect framework, with experience using several connector types HTTP REST proxy, JMS, File, SFTP, JDBC etc.
• Experience in handling huge volumes of streaming messages from Kafka
• Cloud Composer (Apache Airflow) – to build, monitor and orchestrating the pipeline
• Knowledge on BigTable
• Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage
• Experience with open-source distributed storage and processing utilities in the Apache Hadoop family.
• Extensive knowledge on processing various file formats orc, Avro, csv, json, xml etc.
• Knowledge/experience in any ETL tools like DataStage/Informatica – Ability to understand existing on-premises ETL workflows and redesign them in GCP.
• Experience and expertise on Terraform to deploy the GCP's in CI/CD.
• Knowledge/ Experience on connecting to on-prem API's from google cloud.

--

Thank You

Best Regards

Vishnu Pratap Reddy

Direct: 484-243-0577 

Phone: 2143085408 ext 802

Email: Vishnunreddy.yedla@decisionsix.com

Decisionsix Inc.
3553 W Chester Pike #408, Newtown Square PA 19073

Website: www.decisionsix.com

Sender notified by Mailtrack

03/02/22, 08:07:30 PM