Data Engineer
Job Overview
Join our Business Analytics team as a Data Engineer and step into the fast\-paced world of financial services! You'll be instrumental in developing, optimising, and maintaining critical data pipelines and infrastructure, leveraging cutting\-edge technologies like Google Cloud, dbt and Terraform. We are looking for a motivated, collaborative, kind, and humble individual to join our team. This is a fantastic opportunity for someone with a strong foundation in data engineering and a passion for code quality to contribute to the data services relied upon by major financial institutions.
Responsibilities:
- Data Ingestion \& Scalability: Design, develop, and maintain robust, high\-performance Extract \& Load (EL) pipelines using Python and dlt (Data Load Tool), deployed as jobs on GCP Cloud Run.
- Infrastructure Management (IaC): Utilize Terraform to provision and manage core Google Cloud resources, including BigQuery datasets and secure, authorized data views integrated with Entra ID.
- Workflow Orchestration: Build, manage, and ensure the reliability of complex data workflows and task dependencies using Apache Airflow (via Google Cloud Composer).
- Platform Enablement: Establish the foundational infrastructure, CI/CD pipelines, and orchestration necessary for Data Analysts to seamlessly build dbt models atop the ingested data.
- DevOps \& CI/CD: Maintain and enhance platform operations, including automated deployment pipelines (GitHub Actions), Docker containerization, and local development environments to optimize the developer experience.
- Code Quality \& Stability: Enforce high standards for platform stability through rigorous pre\-deploy testing, strict linting (Ruff, Checkov), and proactive code quality assurance.
- GitOps \& Infrastructure First: All infrastructure and code are version\-controlled. Production deployments are fully automated via GitHub Actions, triggered only by merged Pull Requests, ensuring a reliable and auditable process.
- Strict Quality Standards: We maintain clean, maintainable codebases (Python and Terraform) through enforced coding standards and automated pre\-commit hooks (including Ruff and formatting).
- Local\-First Development: Developers use dedicated local Airflow environments and custom Python utilities to thoroughly test infrastructure and data ingestion scripts in development environments before they are deployed.
- AI\-Augmented Engineering: Engineers leverage our internal, custom AI tools to accelerate common tasks such as boilerplate creation, security chain implementation, and efficient data onboarding.
- Bachelor's or Master's degree in Computer Science or equivalent background.
- 0\-2 years of relevant experience
- Strong understanding of fundamental data engineering concepts (e.g., ELT/ETL pipelines, data warehousing, dimensional modeling).
- Experience with Python and relevant data integration tools (e.g., building API clients, working with dlt or similar ingestion frameworks).
- Proficiency in cloud\-native data platforms and infrastructure (e.g., Google Cloud Platform, BigQuery, Cloud Run).
- Proficiency in software engineering principles and practices (e.g., version control with Git, automated testing, CI/CD pipelines).
- Proficiency in databases, workflow orchestration, and Infrastructure as Code (e.g., advanced SQL querying, Apache Airflow, Terraform).
- Excellent analytical and problem\-solving skills.
- Strong communication and collaboration skills and the ability to contribute ideas to a diverse team.
- Ability to work independently and as part of a team.
- Demonstrated ability to work effectively in an autonomous and collaborative environment.
Note: To be considered for this position, please upload both your resume and your official/unofficial academic credentials (transcripts). Applications missing these documents will not be processed.
Our benefits include:
- Health \& Wellness: Health care coverage designed for the mind and body.
- Flexible Downtime: Generous time off helps keep you energized for your time on.
- Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
- Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company\-matched student loan contribution, and financial wellness programs.
- Family Friendly Perks: It’s not just about you. OSTTRA has perks for your partners and little ones, too, with some
- best\-in class benefits for families.
Launched in 2021, OSTTRA unites four businesses that have been at the heart of post\-trade evolution and innovation for over 20 years: MarkitServ, Traiana, TriOptima and Reset.
With an outstanding track record of developing and supporting critical market infrastructure, our combined network connects thousands of market participants to streamline end to end workflows – from trade capture at the point of execution, through portfolio optimisation, to clearing and settlement.
Joining the OSTTRA team is a unique opportunity to help build a bold new business with an outstanding heritage in financial technology, playing a central role in supporting global financial markets. Learn more at www.osttra.com.
Denna annons kommer från indeed. Visa originalannons ↗