Senior/ Principal Data Processing Software Engineer-OSS

Senior/Principal Data Processing Software Engineer-OSS at DataPelago. Job summary: Join DataPelago's engineering team and shape the future of accelerated data processing. The role involves adopting and advancing open-source software platforms such as Apache Gluten, Velox, Apache Spark, and Apache Flink in the context of DataPelago's data processing engine.

Requirements

• BS/MS in Computer Science (or a related field)
• 6+ years of relevant experience
• 3+ years of deep technical experience in instrumenting, analyzing, and optimizing the performance of data processing engine components
• Sound knowledge of the architecture and internal operation of one or more of Apache Spark, Apache Flink, Presto/Trino
• Exceptional programming skills in C, C++, and Java
• Extensive development experience in Linux environments

Benefits

• Competitive compensation
• Stock options
• Comprehensive benefits package
• Leadership development opportunities