MLOps: An overview to Machine Learning Demos

2 min readJun 24, 2022

Overview

How to Build a Machine Learning Demo in 2022

Learn why you should build demos for your Machine Learning models in 2022, and how to do it in a way that fits your…

nicjac.dev

What framework to use, where to host the code, and where to host the model that can be easily loaded into those frameworks.

Model hosting

huggingFace

Gradio

Official website: https://gradio.app/

Gradio(app+deploy) and huggingFace(model hosting)

Pros of Gradio:

Quick and easy setup out of the box
Runs directly in notebooks
Absolutely no knowledge of web development required
Apps are easily shared
Good selection of built-in UI elements
Features such as screenshots or output flagging are very handy for demos

Cons of Gradio:

Limited control over the UI layout
Not suitable for complex apps (e.g. state management, caching)

Sreamlit

Xgboost: https://medium.com/towards-data-science/deploying-ml-models-using-streamlit-5d6212453bdd

Pros of Streamlit:

Quick setup
Advanced features such as caching and state management allow for complex apps to be built
Large selection of built-in UI widgets
Highly customizable UI layout
Extensible through support for custom third-party components

Cons of Streamlit:

Sharing applications is not as trivial as it is using Gradio
Complex apps require some understanding of advanced web development concepts
Not compatible with notebooks
Lacking some basic built-in features for ML demos (e.g. flagging of unexpected inputs/outputs)

HuggingFace Spaces

Spaces

We're on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

Spaces is like a “github page” for models, it creates a repo on huggingface, hosting the codebase serving model. It supports you to choose either Streamlit or Gradio as serving framework.

Check out this video to see how it works:

In this case the model is hosted on huggingface, trained with autoNLP, which still priced quite expensive right now. https://www.youtube.com/watch?v=s-6V6HlwX98&t=0s