Senior Software Development Engineer, Big Data

The Senior Software Development Engineer, Big Data role will develop and support data platform infrastructure using data technologies such as Spark, Hive, Airflow, Databricks, Kafka, Flink, and other industry and internal tools. The role will collaborate with cross-functional team members and data scientists to understand their requirements and provide solutions.

Requirements

• Experience in software development with one or more programming languages such as Python, Java, C++, etc.
• Proficiency in developing and supporting services with cloud infrastructure such as AWS.
• Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes.
• Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink.
• Experience in setting up and optimizing data pipelines
• Experience in developing scalable processes for supporting multiple user groups and teams.
• Familiarity and Experience with running on-call operational responsibilities for data platform systems
• Databricks experience is a plus.
• Experience with Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) is a plus

Benefits

• Competitive base salary
• Benefits
• Equity awards