| Hi | Job Title | Location | Job Description | Duration | Skills | | Senior Big Data Engineer | Remote | Job Description Senior Big Data Engineer: The Senior Big Data Engineer is a key contributor to the design and development of the analytics platform. Responsibilities: - Architecture and design
- Code development.
- Production support.
- Mentoring of junior team members.
- Automation
Requirements Must Haves: - Bachelor's in computer science or closely related discipline.
- 6 plus years of focused experience in Big Data space.
- Experience with any combination of Java. Scala. Python - any combination of 2/3
- Apache Spark Streaming, Spark, Kafka or any other streaming api experience.
- Experience building data processing pipelines at scale on AWS.
- Experience working with different file formats like Avro, Json, Parquet
- Experience in AWS components like EMR, EC2, DynamoDB, Redshift.
- Deep understanding of the concepts involved with managing resources in AWS.
Nice to Haves: - Experience in Rest based microservice architecture
- Ability to lead new and complex projects having multiple dependencies from design phase all the way to production. This may involve facilitating across multiple teams.
- Other skills needed to perform the job (ex: presentation skills, negotiation skills, etc.).
- Nice to have experience in Airflow and Jenkins or other Cl/CD.
- Nice to have experience on different monitoring, alerting dashbording tools like Datadog and PagerDuty.
- Nice to have dev ops experience with focus on cloud formation and terraform.
| Long Term | JAVA, AWS, Big Data, Scala, Python, Apache, Spark, Kafka | | | | |
To unsubscribe from future emails or to update your email preferences click here .
Post a Comment