The Sr. Data Integration Engineer will lead the design, development, and implementation of scalable data solutions, including a Customer Data Platform (CDP) and associated API frameworks.
Requirements
- Develop and maintain scalable data pipelines and workflows using Python and modern data tools.
- Build and maintain production-grade data integrations across internal and third-party systems.
- Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and associated automation in accordance with best practices and security standards throughout the development lifecycle.
- Design and implement a robust, scalable Customer Data Platform (CDP) to centralize and unify customer data from multiple sources.
- Develop and maintain APIs and data pipelines to support real-time and batch data integration between the CDP and internal/external systems.
- Optimize and manage data environments, including data modeling, security practices, and Lakehouse performance.
- Monitor and optimize data flows and API performance to ensure high availability and low latency.
- Troubleshoot and resolve data-related issues, ensuring system reliability and efficiency.
- Collaborate with cross-functional teams including marketing, product, engineering, and business stakeholders to define data requirements and integration strategies.
- Communicate effectively with stakeholders, translating technical concepts into actionable insights.
- Implement data governance and privacy practices to ensure compliance with regulations (e.g., GDPR, CCPA).
- Ensure data quality, governance, and compliance with internal policies and external regulations.
- Utilize Git version control and CI/CD pipelines to deploy and manage data workflows.
- Evaluate and recommend tools, platforms, and technologies to support the CDP and integration framework.
- Document architecture, data flows, and integration patterns to support maintainability and scalability.
- Perform other duties as requested or as needed to fulfill the purpose of the job.
Benefits
- Medical
- Health Savings Account
- Dental
- Vision
- Life Insurance
- Paid Vacation (PTO)
- 401(k) with employer match
- Flexible Spending Account
- Employee Assistance Program (EAP)