We are seeking an Azure Databricks Lead Developer to enable digital transformation for our clients in a global delivery model. You will research on technologies independently, recommend solutions, and contribute to technology-specific best practices and standards.
Requirements
- 4+ years of experience with Information Technology
- Proven years of hands-on experience in Azure, Databricks
- Proficiency in data engineering tools: Spark, Kafka, Airflow, SQL, Python
- Strong understanding of retail or CPG data domains
- Familiarity with vector search and semantic retrieval for retail use cases
- Expertise in data privacy and compliance in consumer-facing environments
- Good experience in end-to-end implementation of data warehouse and data marts
- Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling
- Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, Azure Pipelines, and Jenkins
- Experience designing and implementing complex solutions for distributed systems
- Experience in leading and mentoring teams
Benefits
- Medical/Dental/Vision/Life Insurance
- Long-term/Short-term Disability
- Health and Dependent Care Reimbursement Accounts
- Insurance (Accident, Critical Illness, Hospital Indemnity, Legal)
- 401(k) plan and contributions dependent on salary level
- Paid holidays plus Paid Time Off