LEAD Data ENGINEER

Job Description

Job Description: 

We are seeking a highly experienced and technically adept Lead Software Engineer to guide our team in building low-latency, highly scalable, distributed systems that process large-scale data to power our products. The  ideal candidate will be a hands-on leader, skilled at driving results through others, a mentor to engineers, and a key contributor to our technical strategy, with deep expertise in Scala, Python, Kubernetes, and the AWS  ecosystem, and familiarity with Apache Spark.  

Responsibilities:  

Lead the design, development, and optimization of robust, high-performance distributed systems.  

Drive the delivery of key initiatives by coordinating and guiding the work of other engineers on the team.  

Architect efficient schemas and algorithms for large-scale storage and retrieval of complex data.  

Make architectural decisions and define a long-term technology roadmap.  

Collaborate with product managers, engineering leads, and cross-functional partners to translate business requirements into technical solutions.  

Conduct code reviews and ensure the highest standards of code quality, performance, and maintainability.  

Troubleshoot and resolve complex production issues in distributed environments.  

Stay current with emerging technologies and industry best practices, recommending adoption where appropriate.  

Required Skills: 

8+ years of experience in software engineering, with a focus on distributed, high-performance systems.  

Extensive, hands-on experience with Scala and strong command of functional programming concepts.  

Proficiency in Python for backend development and data processing workflows.  

Proven expertise with Kubernetes and AWS services (EKS, EMR, S3).  

Familiarity with Apache Spark for large-scale data processing.  

Solid understanding of distributed systems architecture, concurrency, and data modeling.  

Demonstrated ability to lead teams, coordinate work across multiple engineers, and deliver results.  

Proficiency with version control (Git) and CI/CD pipelines.  

Preferred Qualifications: 

Experience with geospatial data processing and indexing techniques (e.g., R-trees, H3).