You have a deep learning model running in your console or Jupyter notebook and would like to make it available to your company or deploy it to the world? AIME API is the easy and scalable solution to do so. Turn your script to a secure and robust web API acting as your interface to the mobile, browser and desktop world.

With AIME API one deploys deep learning models (PyTorch, TensorFlow) through a job queue as API endpoint capable of serving millions of model inference requests.

The AIME API Server solution implements a distributed server architecture with a central AIME API Server communicating through a job queue with a scalable GPU compute cluster. The GPU compute cluster can be heterogeneous and distributed at different locations without requiring an interconnect. The model compute jobs are processed through so called compute workers which connect to the AIME API Server through a secure HTTPS interface. The locality of the compute workers can be independent from the API server, they only need internet access to request jobs and send the compute results.

This way we enable the creation of AI-based software products by simply developing a frontend that is connected to the API, to which GPU worker nodes log on in an easily scalable manner. Load balancing is handled by the API server.