Lead Data Engineer Databricks
AllataDallas, Texas, United States
Posted August 13, 2025
Full Time
About the Company
Allata is a strategy, architecture, and enterprise-level application development firm focused on enhancing or scaling business opportunities through custom technologies. We specialize in strategic advisory services, transformational program management, and emerging technologies like AI, IoT, and cloud computing to help businesses become more agile and disruptive. Our company culture emphasizes family, client satisfaction, and community involvement.
Job Description
Allata is seeking a skilled Lead Data Engineer to contribute to transformative enterprise data platform projects. The role involves designing, building, deploying, and optimizing data products using technologies like Databricks, SQL Server, and Azure Data Fabric. Collaboration with clients is key, integrating with their teams or providing independent guidance to deliver measurable results and build lasting partnerships.
Requirements
- Current knowledge of using modern data tools like (Databricks, FiveTran, Data Fabric and others)
- Core experience with data architecture, data integrations, data warehousing, and ETL/ELT processes
- Applied experience with developing and deploying custom whl and/or in session notebook scripts
- Applied experience with SQL, Stored Procedures, and Pyspark-based on area of data platform specialization
- Strong knowledge of cloud and hybrid relational database systems (MS SQL Server, PostgresSQL, Oracle, Azure SQL, AWS RDS, Aurora or comparable)
- Strong experience with batch and streaming data processing techniques and file compactization strategies
