Title: Sr. Data Engineer (Databricks)
Duration: 6+ month
Location: Full Remote
Client: Emids / Cigna
C2C :USC/GC Only
Must Have Skills:
Data bricks, Apache Spark 3.0, AWS - Amazon Web Services, Big Data Hadoop, PySpark, Python, Teradata, Terraform, Amazon S3, AWS Lambda
Required Skills:
Certified Databricks Developers with Spark 3.0
Good experience on designing and developing data pipelines for data ingestion and transformation using PySpark.
Good knowledge on implementing CI/CD pipeline using Terraform scripting
Distributed computing experience using Python and PySpark.
Good understanding of spark framework and spark architecture.
Experience working in AWS Cloud based big data infrastructure.
Excellent in trouble shooting the performance and data skew issues.
Must have good understanding of spark run time metrics and tune applications based on metrics.
Deep knowledge in partitioning, bucketing concepts of data ingestion.
Good understanding of AWS services like Glue, Athena, S3, Lambda
Preferred working knowledge on the implementation of Databricks ETL.
Experience with source code control systems like Bitbucket/Gitlab etc.
Full Legal Name | |
Contact No. | |
E-Mail ID | |
Skype ID | |
Work Authorization | |
DOB (MM/DD) | |
Passport# |
|
Current Location | |
Pay Rate | |
Last 4 SSN | |
Willing to Relocate | |
Highest Education · Degree & Specialization · Year completed · Institution/University | |
LinkedIn URL (if any) | |
Best Time to Reach (Phone, Email or Text) | |
Availability to Join | |
Advance Notice for in-person interview | |
Employment Status | |
Reason for Job Change | |
Employer's Details (if any) |
|
Skill Matrix :
Experience | No. of Years |
Total Experience | |
| DataBrick | |
| Big Data | |
Pyspark | |
| Apache | |
| Python | |
| TeraData | |
| Lambda | |
| AWS | |
| Terraform |
Thanks & Regards
Amit Sharma - Sr Technical Recruiter
Ph : +1(609)7591825
Connect/Follow on LinkedIn for more Job Opportunities
https://www.linkedin.com/in/amit-sharma-a53aa3159/
Email : amit.sharma@maxeleven.com | w: www.maxeleven.com |
Max Eleven LLC
116 Village Blvd. Suite 200, Princeton, NJ 08540
E verify | SBE Set-Aside Program & MBE Certified
Post a Comment