- Agentic AI with LangGraph (tool calling, retrieval, memory) exposed as FastAPI services on Kubernetes.
- Internal React interfaces so analysts run agents, inspect tool calls and flag bad outputs.
- Serve open-weight LLMs with vLLM on CUDA GPUs, batching & quantisation tuned for latency/cost.
- SecDevOps across CI/CD: tool-permission and prompt-injection checks for agent workloads.
// MLOps · Agentic AI · Cloud
David Cardoner
Senior ML / MLOps Engineer & Agentic AI Developer
5+ years across the full ML lifecycle, feature engineering to large-scale production on Azure, GCP and Kubernetes. Today I build LLM agents with LangGraph, serve open-weight models on vLLM, and turn messy data into systems that drive product decisions.
About
Senior ML/MLOps engineer with a strong Python/SQL foundation and a research background, MSc in Statistics & Operations Research and six peer-reviewed publications applying ML and optimization to real forecasting and decision problems.
My recent work centres on agentic AI: LLM agents built with LangGraph, CrewAI and LangChain, served through FastAPI and operated via lightweight React interfaces. I care about the whole path, batching and quantisation for cheap self-hosted inference, CI/CD and Terraform for reproducibility, and SecDevOps checks (tool permissions, prompt injection) for agent workloads.
Strong interest in recommender systems, ranking and personalization.
Tech Stack
Languages
Agentic & LLM
ML & Serving
Data Engineering
Backend & Frontend
Cloud & Infra
Experience
- Azure ML + Databricks pipelines for training and deploying Generative AI across the full lifecycle.
- LangChain/LlamaIndex RAG over internal data; moved to agentic LangGraph workflows with streaming FastAPI.
- Self-hosted LLM inference with Triton + vLLM on GPU nodes as a cheaper alternative to per-token APIs.
- Distributed ML on Ray over Kubernetes; real-time pipelines with Databricks Structured Streaming.
- Terraform IaC; observability with OpenTelemetry, Prometheus and Grafana.
- Containerized cybersecurity detection models (Docker/Kubernetes) for consistent multi-env deployment.
- Azure ML infrastructure + Azure DevOps CI/CD; model inference exposed via Python REST APIs.
- Terraform IaC, Kubernetes RBAC and security policies; OpenTelemetry + Prometheus monitoring.
- Designed ML/DL algorithms for applied forecasting and decision-support, later published in peer-reviewed journals.
- Feature engineering, selection and model optimization; trained DL models on CUDA GPUs.
- Optimization models for decision support over SQL and NoSQL stores.
Notable Projects
gpu-kernel-dev
↗Hands-on lab covering Triton GPU kernels and vLLM internals, with Docker and Colab support.
GenAIandLLMs
↗Generative AI and large-language-model studies, prototypes and experiments.
infrastructure
↗Reusable, Terraform-defined cloud infrastructure.
pr-agent-foundry
↗Autonomous PR builder: deterministic loop + Azure AI Foundry agent that repairs failing CI, stopping at a human gate.
secai-journal
↗Journal covering the latest AI and cybersecurity hot topics.
Publications & Certifications
- Peer-reviewed: A Practical Fault Location Algorithm With Increased Adaptability for Active Low Voltage Grids.
- Peer-reviewed: Feature Selection and Optimization of a ML Fault Location Algorithm for Low Voltage Grids.
- Peer-reviewed: Reliability Assessment of a Fault-Tolerant PV Multistring Inverter.
- Peer-reviewed: Optimal management for an innovative EV charging station with ML forecasting modules.
- Peer-reviewed: How Building & District Algorithms Enhance Renewable Energy Integration in Energy Markets.
- Cert: HashiCorp Terraform Associate · ML Engineering for Production (MLOps) · DeepLearning.AI & Hugging Face agent/LLM tracks.
// Let's talk
Get in touch
Open to work on innovative AI & Cloud projects, and to collaboration on agentic systems and ML in production.