Data Engineer (Snowflake)

Allata is a global consulting and technology services firm seeking a Senior Data Engineer to improve data reliability and quality. This role involves architecting, developing, and maintaining scalable data pipelines, leveraging cloud platforms like Azure or AWS. The ideal candidate will be resourceful, passionate about data, and comfortable with building robust and reliable data workflows.

Requirements

• Advanced skills in Python and PySpark for high-performance distributed data processing.
• Proficient in creating data pipelines with orchestration frameworks like Apache Airflow or Azure Data Factory.
• Strong experience with Snowflake, SQL Data Warehouse, and Data Lake architectures.
• Ability to write, optimize, and troubleshoot complex SQL queries and stored procedures.
• Deep understanding of building and managing ETL/ELT workflows using tools such as DBT, Snowflake, or Azure Data Factory.
• Hands-on experience with cloud platforms such as Azure or AWS, including services like S3, Lambda, Glue, or Azure Blob Storage.
• Proficient in designing and implementing data models, including star and snowflake schemas.
• Familiarity with distributed processing systems such as Spark, Hadoop, or Databricks.
• Develop robust, efficient, and reusable pipelines to process and transform large-scale datasets.
• Design pipeline workflows for batch and real-time data processing using orchestration tools.
• Implement automated data ingestion frameworks to extract data from structured, semi-structured, and unstructured sources.

Benefits

• Competitive salary
• Opportunities for professional development
• Collaborative work environment