Systems & Data Infrastructure Engineer

Functional Focus: Data Engineering, Real-Time Streaming, and HPC Job Orchestration Scientific Data Architecture: Design crash-safe, binary data formats capable of handling high-speed incremental writes from compute jobs and concurrent reads for query-time calculations. Operational Data Modeling: Design and maintain a relational database schema via an async ORM, backend-agnostic across database engines. HPC Workload Management: Manage the lifecycle of batch and interactivecompute jobs, handling subprocess monitoring, status polling, and cluster filesystem coherency. Real-Time API & Streaming: Build async backend services and long-lived, server-pushed event channels with backpressure handling, and enforce role-based access control on all APIs.…