Data Engineer

Ostium is looking for a senior-level data engineer to spearhead our ambitious efforts on the data side. We want to have ambitious goals for our data team; this person will be central to building Ostium's vision for data and executing it.

This is an on-site position based in our New York office.

WHAT YOU'LL DO

- Maintain, improve, and optimize a new data pipeline to handle massive scale effectively. It’s “stock” right now; we need to optimize it for our unique needs.

- Use 100% IaC to build, maintain, deploy, and manage applications and services.

- Data Best Practices - Help engineers who are responsible for using the pipeline to understand how it works and how they can leverage it effectively.

- Curate massive data sets, optimize data pipelines, and efficiently querying data.

- Empowering the Team - Building tools to make ingesting new data a few hours work with AI. Then structuring the pipeline in a way where any person at this company can ask AI any question to understand whatever they need.

WHO YOU ARE

TECHNICAL REQUIREMENTS:

- Experience with data modeling tools (DBT, sqlmesh) and data orchestration tools (Airflow, Dagster, Prefect).

- Experience with Postgres, Clickhouse, and other OLTP and OLAP data stores.

- Deep understand of how data is stored, computed, and how to optimize queries.

- Hands-on experience with Terraform, ArgoCD, GitHub Action, Docker, Prometheus, and Grafana. Evangelist of Infrastructure as Code (IaC).

- Strong understanding of modern data pipelining and best practices.

CHARACTERISTIC REQUIREMENTS: