Overview

This guide will walk you through how to quickly install Thoras and get to see resource recommendations for your workloads in just a few minutes.

What you’ll need

  1. Your Thoras license key, provided by your Thoras point-of-contact.
  2. Helm
  3. Privileged access to a Kubernetes cluster
  4. The cluster should already have Kubernetes metrics server installed. To install Kubernetes metrics server:
    kubectl apply -f https://github.com/kubernetes-sigs/metrics-server/releases/latest/download/components.yaml
    

Install

Getting Thoras up-and-running

Set up Thoras Helm repo

Install the Thoras Helm repo, which will give you access to all of the Thoras Helm charts

helm repo add thoras https://thoras-ai.github.io/helm-charts
helm repo update thoras

Install Thoras

  1. Move your license key to a file and note the file name. We’ll use thoras_license.txt in our example below
  2. Install Thoras via Helm:
helm install thoras thoras/thoras \
    --namespace thoras \
    --create-namespace \
    --set imageCredentials.password="$(cat ./thoras_license.txt)"

Verify installation

It should only take 1-2 minutes for all Thoras pods to come online. Verify that all pods are healthy by confirming their Running status:

kubectl get pods -n thoras

Once all pods are in Running status, congratulations! You’ve successfully installed Thoras!

Get Resource Recommendations

Now that Thoras is up and running, we’re just minutes away from getting resource recommendations that will help our workloads run more efficiently — saving on cloud costs while boosting reliability.

Pull up the dashboard

We’ll be working out of the Thoras Dashboard from here on out. To access it:

  1. Port-forward to the dashboard pod
kubectl port-forward service/thoras-dashboard 8080:80
  1. Pull up the dashboard in your browser: http://localhost:8080

Thoras will auto-discover workloads in your cluster on a fresh installation and give you the option to onboard all the workloads in a namespace, zero configuration needed! This is a great way to experiment and see the value of Thoras quickly!

  1. Select a namespace you’d like recommendations for and click “Auto-create”

  1. You’ll see a new popup where Thoras tells you it’s populating AIScaleTargets for you
  2. You’ll see live workload targets on the left-hand column. Try selecting one!

  1. You should immediately see metrics beginning to collect!

  1. Predictions will run on a 15m interval (this is configurable), but let’s trigger one manually for now so we don’t have to wait. Click the blue button in the UI

Viewing resource recommendations

Predictions will become more accurate over time as the Thoras Reasoning Engine learns more about your environment. But we can still get useful Predictions even on the first forecast! Let’s dive in.

Workload right-sizing recommendations

Upon installing Thoras, we can immediately begin visualizing opportunties for efficiency, cost saving, and increased reliability. Workload-rightsizing suggestions are a great example of this. Let’s take a look.

  1. Select Average Usage and Recommended Request from the graph dropdown
  2. Select Last 15m under the timerange on the right-hand side
  3. Select Memory (or leave on CPU) on the resource toggle and the container name that you’re interested in seeing predictions for

You can see the graph that compares the workload usage compared to Thoras recommended requests

  1. And even more interestingly, check out your workload’s utilization. We find that workloads targeting between 80-85% are the most cost efficient. It looks like these workloads are very overprovisioned. We’ve got some work to do!

Explore the UI

There are more graphs than just Average Usage and Recommended Request. Check out Usage vs Actual Total Usages and Suggested Replicas vs Actual for HPA recommendations!

Getting support

Don’t hesitate to reach out to your Thoras point-of-contact — we’re here for any questions 24/7!