Job Title: Big Data Engineer
Location: San Jose, CA / Ideally from Bay AREA/ PST/MST
Duration: Long-Term Contract
$65/Hour on C2C - Net 45
Job Description:
Detailed JD:
The Challenge:
What you will do:
What you need to succeed:
Preferred Qualifications:
Location: San Jose, CA / Ideally from Bay AREA/ PST/MST
Duration: Long-Term Contract
$65/Hour on C2C - Net 45
Job Description:
- Experience with Databricks on Azure
- Experience with on-prem Hadoop migration to Azure
- 2+ years of experience working with Hadoop as platform administrator or SRE
- 2+ years of experience working with Big Data Platform on Cloud, such as Azure, AWS, or GCE
- 1+ years of experience working with Databricks on Cloud
- Security oriented mind, always on lookout for ways to secure large set of data
- Automation skills, eager to automate anything with the use of any scripting language or tool
- Understand the business need as well as the technical need of using a monitoring framework
- Excellent communication skills and a strong team player
Detailed JD:
The Challenge:
- Running a production platform with petabytes of data is no easy task, considering you, the Big Data Platform SRE, must
- Keep the data available and secure at all time
- Build a robust observability framework to identify and handle potential issues
- Constantly improve platform performance and reduce overall business operation cost
- Now, what if you are to handle multiple big data platforms? What about migrating data and workloads from one to another?
What you will do:
- Study Hadoop Platform workloads, understand the data relationship and prepare them for migration to Databricks on Azure cloud
- Setup and maintain production scale Databricks environment on Azure
- Implement monitoring solution for workloads running on Databricks on Azure
- Implement security solution to lock down data used by Databricks on Azure in accordance with Adobe security policy
- Implement onboarding automation for tenants who wants to use Databricks on Azure
- Work with 3rd party vendor for troubleshooting and support on Databricks on Azure
What you need to succeed:
- 2+ years of experience working with Hadoop as platform administrator or SRE
- 2+ years of experience working with Big Data Platform on Cloud, such as Azure, AWS, or GCE
- 1+ years of experience working with Databricks on Cloud
- Security oriented mind, always on lookout for ways to secure large set of data
- Automation skills, eager to automate anything with the use of any scripting language or tool
- Understand the business need as well as the technical need of using a monitoring framework
- Excellent communication skills and a strong team player
Preferred Qualifications:
- Bachelor's or master's degree with equivalent experience in Computer Science or equivalent technical fields
- Experience with Databricks on Azure
- Experience with on-prem Hadoop migration to Azure
- Ability to take the lead and interact with internal and external team members with minimal supervision
Thanks & Regards,
| Karthick Ashok Recruitment Executive
|
Post a Comment