# Serving

## Gateway

![](https://52056325-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MESaD8WY3ggQLtBByXl-887967055%2Fuploads%2Fgit-blob-7cec50fa1e5758f84d03af1280b3ee7c0a1a70a7%2Fgateway-service-diagram%20\(1\)%20\(4\)%20\(6\)%20\(6\)%20\(4\).png?alt=media)

Gateway is a service responsible for routing requests to/from or between Servables and Applications and validating these requests for matching a Model's/Application signature.

The Gateway maps a model’s name to a corresponding container. Whenever it receives a request via HTTP API, GRPC, or Kafka Streams, it communicates with that container via the gRPC protocol.

![Gateway enables data flow between different stages in an Application Pipeline](https://52056325-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MESaD8WY3ggQLtBByXl-887967055%2Fuploads%2Fgit-blob-21d194c9ff522343434c138e467b6505d6526d25%2Fapplication-and-gateway-relation%20\(1\)%20\(4\)%20\(6\)%20\(6\).png?alt=media)

## Manager

![](https://52056325-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MESaD8WY3ggQLtBByXl-887967055%2Fuploads%2Fgit-blob-3bd2147b4aeed8828c187f2e9f0ff28339517497%2Fmanager-service-diagram-1%20\(1\)%20\(4\)%20\(6\)%20\(6\)%20\(3\).png?alt=media)

Manager is responsible for:

* Building a Docker Image from your ML model for future deployment
* Storing these images inside a Docker Registry deployed alongside with

  manager service
* Versioning these images as Model Versions
* Creating running instances of these Model Versions called Servables

  inside Kubernetes cluster
* Combining multiple Model Versions into a linear graph with a single

  endpoint called Application