Architect and manage Databricks clusters, workspaces, and integrations with cloud services. Implement CI/CD pipelines for Databricks notebooks and jobs. Optimize cluster configurations for cost and performance.
Requirements
- Bachelor's degree required
- Minimum 7 years of total experience in cloud-based data platforms
- Minimum 5 years experience with Databricks
- Strong knowledge of Spark architecture and distributed computing
- Hands-on experience with Terraform or other IaC tools
- Experience with Unity Catalog and Delta Lake
- Familiarity with Kubernetes and container orchestration
- Strong scripting skills (Python, Bash)
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills, with the ability to work effectively in a team environment
Benefits
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Parental Leave
- 401(k) Retirement Plan
- Group Term Life and Travel Assistance
- Voluntary Life and AD&D Insurance
- Health Savings Account, Health Care & Dependent Care Flexible Spending Accounts
- Transit and Parking Commuter Benefits
- Short-Term & Long-Term Disability
- Tuition Reimbursement, Personal Development, Certifications & Learning Opportunities
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Care.com annual membership
- Employee Assistance Program
- Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)