Position – Data Engineer
Location –Sacramento, CA
Responsibilities:
· Design, Build, Test & Deploy Data pipelines which facilitate data acquisition & processing of data from variety of source systems.
· Design, Build, Test & Deploy Data persistent layers like Data lake, Datawarehouse, No SQL databases based on the need of the engagement.
· Work across Big Data systems either on premise or on Cloud platforms like GCP
· Build proactive data validation automation to catch data integrity issues.
· Troubleshoot and resolve data issues using critical thinking.
· Build tabular and/or visualization reports that help to articulate data quality and business impact.
· Work independently and with team members to understand and document database structure and business processes.
· Communicate and present on technical information with non-technical team members and stakeholders.
· Comply with the standard and organization requirements relative to specific assignments.
Requirements:
- At least 3-5 years of overall IT experience with 3 years in building modern data pipelines (Spark) to be deployed either in cloud or data center using Scala/python etc
- Experience with one standard ETL/ELT tool available in the market (Talend/Pentaho/Informatica etc)
- At least 2 years of working with BigData system built on Hadoop along with the peripheral technologies like Spark/kudu/presto/Hive/Hbase/HDFS/Yarn etc
- Hands on experience in Apache Kafka and similar streaming platforms provided by the cloud vendors.
- Good understanding of Data profiling, data quality policies and rules to be built for data cleansing.
- Good understanding of building different patterns of Data transformation
- Has experience in building Data visualization through any Data Viz Tool
- At least 2-3 years of experience in working with different types of data repositories Hadoop based Data Lake, Cloud storage based data lake, Datawarehouse, Modern Datawarehouse like Redshift/snowflake/BigQuery, NoSQL database etc
- Any Data Engineering Certification with one of the Cloud providers would be good (GCP/AWS/Azure)
- Good experience in SQL and query writing is required.
- Strong Problem-Solving, Verbal and Written communication skills
Thanks & Regards
|
Mohd Saif Khan
saif@signinsol.com || www.signinsol.com || Contact number-814-651-6955
Please follow to receive more updates .
To be removed from our mailing list, please reply with "REMOVE" in the subject heading and your email address in the body.
Include complete address and/or domain/ aliases to be removed. this mail cannot be considered Spam as long as we include contact information
Post a Comment