Pinely

Python Infrastructure Engineer

Pinely Amsterdam, North Holland, Netherlands Today
engineering

We’re looking for an experienced Python Infrastructure (Software) Engineer to join our ML Infrastructure team. In this role, you’ll build and maintain the ML training stack - data pipelines, orchestration, configuration, experiment tracking, and reproducibility tooling - to accelerate day-to-day research. You’ll work closely with our Research team to enable novel, ML-driven approaches to developing and evaluating strategies, turning early ideas into production-ready systems. Your focus will be on performance, scalability, and reliability - shortening the path from experiment to deployment and delivering measurable business impact.

Responsibilities:

  • Implement complex storage formats and data retrieval methods around researchers’ workflows (partitioning, compression, indexing, caching) to speed up exploration and reduce costs;
  • Improve training throughput and reliability by profiling pipelines, refining job orchestration/parallelism, and removing bottlenecks;
  • Create simple, well-documented interfaces for feature and target engineering, with safeguards against leakage and drift;
  • Ensure reproducibility and insight through standardized experiment tracking (configs, metrics, artifacts) and lightweight reports/dashboards;
  • Collaborate with the Research team to implement innovative ML-based research experiments - rapidly turning training algorithms and experimental recipes into reusable, well-tested components with clear configs and documentation.

Requirements:

  • 5+ years of professional experience as a Python/C++/Go Engineer;
  • Strong knowledge of Python internals (CPython, GIL, memory/object model) and profiling tools (cProfile, py-spy, line-profiler);
  • Understanding of Linux fundamentals - shell, containers, and how processes, memory, and I/O work;
  • Ability to design clean and ergonomic frameworks with clear APIs;
  • Ability to work in a fast-paced environment and efficiently multitask;
  • Experience contributing to projects with complex architectures.

Nice to have:

  • Experience with PyTorch or JAX;
  • Experience developing high-load services;
  • Proficiency with NumPy/Pandas/Polars and columnar data formats (Parquet/ORC);
  • Familiarity with configuration and experiment tooling such as Hydra/OmegaConf;
  • Experience with metrics/logging dashboards (e.g., Prometheus/Grafana);
  • Background in markets/trading or time-series data;
  • Any experience in competitive programming contests (IOI, ICPC, Hash Code) or CTFs.

What we offer:

  • Competitive compensation above the market with bonuses twice a year up to 50% of annual salary;
  • Sophisticated internal training and development programs;
  • Comprehensive health insurance;
  • Reimbursement for sports activities;
  • Engaging in corporate events twice a year;
  • High level of influence and ownership of the process;
  • Work closely with experienced team in a flat organizational structure.

Sponsored

Explore Engineering

Skills in this job

People also search for