Senior data engineers at Thoughtworks are responsible for building, maintaining and testing software architecture and infrastructure for managing data applications. They work on the latest big data tools, frameworks and offerings, and are involved in enabling credible and collaborative problem solving to execute on a strategy.
Requirements
- Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
- Develop intricate data processing pipelines, addressing clients' most challenging problems
- Collaborate with data scientists to design scalable implementations of their models
- Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
- Use different distributed storage and computing technologies
- Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
- Collaborate with the team on the areas of data governance, data security and data privacy
- Incorporate data quality into your day-to-day work
Benefits