Join Billups, a 450-person global team, as a Senior Data Engineer to build and maintain the company's data backbone, maximizing automation, efficiency, and scalability. Collaborate with data science/analytics teams to turn prototypes into robust production data products.
Requirements
- 5+ years of professional experience in data engineering for a Senior role
- 7+ years with demonstrated technical leadership for a Lead role
- Advanced proficiency in Python for data engineering
- Extensive hands-on experience with PySpark for processing large-scale datasets
- Practical, in-depth experience with the Databricks platform
- Strong understanding of how to optimize Spark jobs for performance and cost
- Ability to write, debug, and optimize complex SQL queries
- Strong experience with AWS cloud services, particularly S3 for data storage and SQS/SNS for messaging, serverless functions
- Solid understanding of Data Lake and Data Warehouse architectures and design principles
- Experience with workflow orchestration tools like Apache Airflow (or Prefect, Dagster) and building/maintaining CI/CD pipelines (e.g., GitHub Actions)
- Foundational knowledge of Docker and Kubernetes
- Professional fluency in English
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan