Large-scale data migration products

Moving customer data between systems is a product in its own right at Ironbook AI. I architect the pipelines that do it.

Large migrations are long-running, multi-step and failure-prone. They have to be repeatable, observable and automated rather than run by hand.

1. 01

   Pipelines, not scripts

   Architected large-scale migration pipelines using ETL tools: extract from the source, transform, load into the target.

2. 02

   Orchestrate on Kubernetes

   Automated the workflows with Argo Workflows on Kubernetes, so each migration runs as a defined, repeatable sequence of steps.

Simplified view of how the pieces connect.

• Migrations run as automated, repeatable workflows
• Orchestrated with Argo Workflows on Kubernetes

Details are generalised to respect employer and client confidentiality. Numbers shown are the ones I can share.