Back to all posts

Data & ML

Data engineering, Airflow, and machine learning in production.

Data & ML

Integrating Cloud AI & ML: A Guide for Startup Decision Makers

4/4/2023

Evaluate cloud AI and ML options for startup use cases, including cost, data readiness, vendor fit, deployment risk, and operating needs.

Read More
Data & ML

Creating a custom XCom backend in Airflow

6/23/2022

Technical walkthrough for implementing an S3-backed custom XCom backend in Apache Airflow. Includes practical decision points for planning, implementation, and review.

Read More
Data & ML

Scaling Airflow Workers in EKS

6/20/2022

Learn how to scale Airflow workers in EKS, match capacity to workload demand, and reduce idle Kubernetes spend with version-aware guidance.

Read More
Data & ML

Deploying Airflow and MLflow in Kubernetes on AWS EKS

6/12/2022

Deploy Airflow and MLflow on AWS EKS with Helm, Git sync, S3 logs, image workflow notes, and version-sensitive implementation guidance.

Read More
Data & ML

How to Use Machine Learning In Your Business

2/22/2021

Understand machine learning methods, common algorithms, business use cases, data requirements, and implementation patterns for teams.

Read More

Next step

Ready to get started?

Choose how you'd like to begin your engagement with Pilotcore.

Full engagement

Full consultation

Discuss your complete cloud and security strategy with the principal consultant. For comprehensive transformations and multi-quarter engagements.

Recommended start

Start with a pilot

Test the engagement with a focused 1-4 week scope. See real results, on a fixed timeline, before committing to anything larger.