Senior Data Engineer
Location: Bellevue WA
Duration: Long Term
• Builds framework for auditing, error logging and master data management for the team’s pipelines to meet business needs and ensure our pipelines become more performant, scalable and reliable
• Develops data pipelines, digging into data anomalies and writing infrastructure as code to deploy changes to the cloud
• Collaborates on analysis, architecture, design, and development of data warehouse and business analytics solutions
• Experience working with large scare complicated datasets
• Experience with relevant technologies and of Enterprise-Level System implementations suchas Data Warehouse, ETL Automation, and Cloud-Based Data Management Tools
• Experience with data engineering, ETL, modeling and architecture
• Experience using an applicable programming language and common data technologies (such as SQL, NoSQL, Spark, Python)
• Experience working with big data processes including ETL/data pipelines, processing, storage, and governance • Azure Data Factory Pipelines, Databricks, Azure Data Lake Storage, Data Lakehouse Architecture
• ETL, SQL, Python, C#, PowerShell
• Agile, DevOps principles
• CI/CD pipeline
Post a Comment