Wayne Lambert
Senior Software Engineer specialising in designing and building scalable, production-grade systems, with expertise in distributed systems, complex data processing, and platform infrastructure supporting high-performance, data-driven applications.
Proven track record of engineering distributed systems handling billions of records across hundreds of customer environments. Skilled in developing high-performance data-driven applications, asynchronous processing workflows, and efficient, fault-tolerant data pipelines at scale.
Partners with product and engineering leadership to shape technical direction, clarify architectural constraints, and deliver solutions that balance robust system design with practical product and operational requirements. Operates across application, data, and infrastructure layers, with experience in containerised deployments, automated pipelines, and cross-system integrations.
Senior Software Engineer (Python / Django)
Python Web Engineer
- Designed and implemented a resource-aware ELT scheduling orchestrator supporting asynchronous and multi-threaded data processing, regulating concurrent workloads across >250 customer environments to maintain system stability and prevent resource contention at scale
- Built and operated distributed ELT pipelines processing approximately 1.7 billion records nightly, ensuring reliable ingestion from relational databases and OData APIs while reducing downstream failure risk
- Reduced large-scale ELT execution time from almost 15 hours to approximately 3–3.5 hours across distributed customer environments through optimised collection, scheduling, database procedures, and SQL Server tuning, achieving required overnight performance without unnecessary resource saturation
- Evolved a multi-tenant architecture supporting hundreds of isolated customer environments on shared infrastructure, enabling efficient resource utilisation, scalability, and consistent deployment patterns
- Influenced technical and product direction by identifying system constraints, proposing architectural solutions, and guiding implementation approaches in collaboration with product and engineering leadership
- Engineered database-level processing using stored procedures and cross-database queries (including SQL Server linked servers), enabling efficient data movement across distributed systems
- Implemented pre-execution data integrity safeguards, including endpoint availability validation, reducing the likelihood of incomplete data collection and preventing downstream inconsistencies
- Built and maintained automated deployment pipelines using Jenkins, orchestrating container lifecycle (teardown, rebuild, redeploy) across multi-service environments and validating readiness of application, database, and supporting services (Redis, Celery, schedulers, web servers)
- Designed and optimised Docker-based environments, improving build efficiency through layering, ensuring deterministic, reproducible, and portable runtimes across environments
- Implemented monitoring and diagnostic tooling across applications and deployments, improving system observability and reducing time to detect and resolve production issues
- Designed and built data-driven web applications using Python, Django, HTMX, and JavaScript, supporting complex user workflows through a combination of server-rendered, AJAX, and client-side interaction patterns
- Developed comprehensive automated test coverage for Python applications, including hundreds of unit tests (pytest) and system-level pipeline testing, improving confidence in application behaviour and reliability at scale
- Configured and optimised Nginx-based web infrastructure, enabling efficient request handling, reliable application access, and performant static asset delivery
- Acted as team specialist for Git workflows, resolving complex branching and merge issues and reducing delivery risk during releases
HR BI Specialist
- Developed data analysis solutions within enterprise environments, while independently transitioning from traditional BI tooling to programmatic data processing using Python (Pandas, NumPy, Matplotlib), including exploratory models and simulations.
BI Developer & Data Migration Specialist
- Built data migration solutions as part of an end-to-end initiative consolidating legacy systems into a unified platform, ensuring data integrity and process automation.