Location: Tel Aviv, Israel
Scope: Full-time
Reports to: Team Lead, R&D
About the Role
As a Senior Data Engineer, you will be a crucial part of our R&D team, contributing to the design and implementation of real-time data pipelines with a focus on scalability and distributed systems. Your responsibilities will include managing database ingestion across both the data and query layers and leading the development process from conception to delivery. Collaboration with cross-functional teams is integral to ensure the optimization and impactful integration of your features. Join us in pushing the boundaries of excellence and contributing to the growth and success of our dynamic team.
Responsibilities
- Lead the development of real-time data pipelines, focusing on scalability and distributed systems.
- Create and manage database ingestion on both the data layer and the query layer.
- Lead the development process from design through implementation to delivery.
- Collaborate closely with Product, DevOps, and Client Services to maximize the impact of features.
- Collaborate with team members on technological and architectural discussions.
Requirements
- Over 10 years of software development experience.
- Over 5 years of data engineering experience.
- Experience in building scalable and highly available pipelines using proven technologies such as Kafka and Spark.
- At least 3 years of experience in PostgreSQL and in particular Amazon RDS for PostgreSQL.
- Experience in Kafka, Spark, PostgreSQL, Redis and Clickhouse.
- Experience working with databases (OLTP or OLAP) with a focus on scalability and optimized performance.
- Experience in the entire Software Development Lifecycle, covering requirements, architecture, design, development, testing, code review, deployment, documentation, debugging, and refactoring.
- Understanding of Software Design concepts like SOLID, Testability, Modularity, and Traceability.
- Familiarity with GoLang, Scala, Python, Linux, Docker, DevOps, data and databases, microservices, and event-based systems.
- Experience in developing services hosted on AWS, Azure, or Google Cloud Platform.
- BSc in Computer Science, Software Engineering, or a related field.
