Data Engineer (Databricks / Pyspark)

BAT is evolving at pace into a global multi-category business. Our purpose is to create A Better TomorrowTM by Building a Smokeless World. We are looking for a Data Engineer (Databricks / Pyspark) in Monterrey, Mexico.

Requirements

• Implement data ingestion pipelines from multiple data sources using Databricks and PySpark, ensuring the quality and consistency of data.
• Develop Big Data and non-Big Data cloud-based enterprise solutions in PySpark, SQL and related frameworks/libraries.
• Understand Data Architecture concepts.
• Processing performance analysis and optimization.
• Bringing standard methodologies in the following areas: Design & Analysis, Automation, Testing, Monitoring, Documentation.
• Coordinates issue resolution with multi-functional teams and vendors.
• Assists the project manager by assisting sharing work plans, effort estimates and delivery timelines for work you're doing.

Benefits

• Market leading annual performance bonus
• Diverse health plans
• Initiatives for work-life balance
• Transportation support
• Flexible holiday plan with additional incentives
• Online learning platforms
• Personalized growth programs
• Global Returners program for professionals seeking to re-enter the workforce