Data Engineer

We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats.

KEY RESPONSIBILITIES

Develop and optimize Spark workloads in cloud environments Work with

large datasets using Parquet and Iceberg

Translate requirements into robust engineering solutions

Ensure performance, reliability, and maintainability

Contribute to monitoring, documentation, and deployment

MUST HAVE

Strong Python and PySpark

Hands-on Apache Spark, cloud preferred

Databricks experience

Large-scale data systems expertise

Client-facing delivery background

Independent problem-solving in ambiguous settings

NICE TO HAVE

AWS Glue and Lake Formation

Airflow and orchestration tools

Distributed data architectures

Capital markets exposure

Originally posted on Himalayas