Getting Started | Katana ML

Engine and Communication parts are generic and can be reused. A group of ML services is provided for sample purposes. You should replace a group of services with your own. The current group of ML services works with Boston Housing data. Data service is fetching Boston Housing data and converts it to the format suitable for TensorFlow model training. Training service builds TensorFlow model. Serving service is scaled to 2 instances and it serves prediction requests.

File Structure

skipper

api - Web API
logger - Logger service
rabbitmq - Message broker
services - Sample ML services
skipper-lib - Helper library
workflow - Generic workflow
README-GKE.md - Instructions for Google Kubernetes Engine
README-OKE.md - Instructions for Oracle Container Engine for Kubernetes
README.md
docker-compose-kubernetes.yml - Docker Compose script to build containers for Kubernetes
docker-compose.yml - Docker Compose script to build Skipper images and run containers, when not using Kubernetes
kubectl-remove.sh
kubectl-setup.sh - Kubernetes infra setup
nginx_config.conf

Start/Stop

Docker Compose

Start:

docker-compose up --build -d

This will start Skipper services and RabbitMQ.

Stop:

docker-compose down

Web API FastAPI endpoint:

http://127.0.0.1:8080/api/v1/skipper/tasks/docs

Kubernetes

NGINX Ingress Controller:

If you are using local Kubernetes setup, install NGINX Ingress Controller

Build Docker images:

docker-compose -f docker-compose-kubernetes.yml build

Setup Kubernetes services:

./kubectl-setup.sh

Skipper API endpoint published through NGINX Ingress (you can setup your own host in /etc/hosts):

http://kubernetes.docker.internal/api/v1/skipper/tasks/docs

Check NGINX Ingress Controller pod name:

kubectl get pods -n ingress-nginx

Sample response, copy the name of 'Running' pod:

            
                NAME                                       READY   STATUS      RESTARTS   AGE
                ingress-nginx-admission-create-dhtcm       0/1     Completed   0          14m
                ingress-nginx-admission-patch-x8zvw        0/1     Completed   0          14m
                ingress-nginx-controller-fd7bb8d66-tnb9t   1/1     Running     0          14m

NGINX Ingress Controller logs:

kubectl logs -n ingress-nginx -f

Skipper API logs:

kubectl logs -n katana-skipper -f -l app=skipper-api

Remove Kubernetes services:

./kubectl-remove.sh

Components

api - Web API implementation
workflow - workflow logic
services - a set of sample microservices, you should replace this with your own services. Update references in docker-compose.yml
rabbitmq - service for RabbitMQ broker
skipper-lib - reusable Python library to streamline event communication through RabbitMQ
logger - logger service

API URLs

Web API:

http://127.0.0.1:8080/api/v1/skipper/tasks/docs

If running on local Kubernetes with Docker Desktop:

http://kubernetes.docker.internal/api/v1/skipper/tasks/docs

RabbitMQ:

http://localhost:15672/ (skipper/welcome1)

If running on local Kubernets, make sure port forwarding is enabled:

kubectl -n rabbits port-forward rabbitmq-0 15672:15672

PyPI - skipper-lib is on PyPI

OKE - deployment guide for Oracle Container Engine for Kubernetes
GKE - deployment guide for Google Kubernetes Engine

You can use Skipper engine to run Web API, workflow and communicate with a group of ML microservices implemented under services package.

Skipper can be deployed to any Cloud vendor with Kubernetes or Docker support. You can scale Skipper runtime on Cloud using Kubernetes commands.

Katana ML Skipper

File Structure

Instructions

Start/Stop

Docker Compose

Kubernetes

Components

API URLs

Skipper Library on PyPI

Cloud Deployment Guides

Usage

License