Tech Lead - Data Engineering
The Citco Group LimitedCork, Ireland
Posted September 25, 2025
Full Time
About the Company
The Citco Group Limited is a leading provider of financial and professional services with a heritage dating back to the 1940s. Specializing in fund administration, technology development, investor relations, banking, and governance services, the company offers comprehensive solutions for alternative investments, private equity, and real estate. With a strong commitment to innovation and client service, Citco is recognized as a trusted advisor in navigating complex market changes.
Job Description
Citco is seeking a Tech Lead – Data Engineering to architect, implement, and optimize data solutions on Databricks. This role involves leading a technical team, integrating with AWS services, and ensuring performance, security, and scalability. The ideal candidate will have a deep understanding of Databricks internals and a track record of delivering large-scale data platforms in a cloud environment.
Requirements
- Architect and maintain Databricks Lakehouse solutions using Delta Lake for ACID transactions and efficient data versioning.
- Integrate Databricks with AWS S3 as the primary data lake storage layer.
- Develop and maintain scalable, reusable ETL frameworks using Spark and Python/Scala.
- Conduct advanced Spark job tuning (caching strategies, shuffle partitions, memory optimization).
- Fine-tune Databricks clusters (autoscaling policies, instance types) to manage cost without compromising performance.
- Conduct advanced Spark job tuning (caching strategies, shuffle partitions, memory optimization).