YellowDog Platform

Home >YellowDog Platform

The Growing Demand For Computing Power

The volume of data generated worldwide is rapidly increasing, with greater volumes than ever before needing real-time processing. This unprecedented rise has led to an explosion of complex simulation applications, machine learning and AI, driving the generation of compute-intensive workloads.

This previously would have meant more investment in capital infrastructure and the necessary level of expertise. However, the cloud breaks down these barriers and enables companies to use the infrastructure they need, as and when they need it.

Nevertheless, scaling your applications across the cloud can be challenging. Without aligning the computing resource you need with your workload’s fluctuating requirements, you could end up overspending and missing your deadlines.

With the YellowDog Platform, you can benefit from all the cloud has to offer, without any limitations. Our powerful scheduler works seamlessly alongside our intelligent provisioning tools, so you can manage your workloads across different geographical regions, machine shapes and instance lifecycles.

What Does the YellowDog Platform Deliver?

Rapid Scaling

Access unparalleled scale and easily manage computing resources from multiple providers, regions, and machine shapes.

Dynamic Clusters

Respond to the specific needs of your workload with computing clusters that are composable and can expand and contract, as required.

User-Friendly Solution

Deliver workloads on time and on budget with a solution that is cloud native, fault tolerant and accessible via an easy-to-use User Portal.

Cloud Native Scheduling

The YellowDog Scheduler has been built with the cloud in mind. It is free from the restrictions of traditional legacy tooling and can enable users to scale far beyond existing technologies, across multiple regions, data centres and instance shapes.

It has the ability to utilise Spot instances, where other tools cannot, acting as both a scheduler and meta-scheduler to work with loosely and tightly coupled workloads. It also removes complexity with a single cluster view – with no need to consider multi-data centre/provider configurations.

The addition of YellowDog’s Object Store Service, gives the Scheduler access to a coherent data surface for workloads, regardless of the cloud provider and location.

The YellowDog Index

The YellowDog Index is a free, normalised, global cloud data resource that analyses the vast array of compute provided by the main public cloud providers: Amazon Web Services (AWS), Google Cloud Platform (GCP), Microsoft Azure, Oracle Cloud Infrastructure (OCI) and Alibaba Cloud. Using a range of filters, you can select the compute properties you need, and the YellowDog Index will organise the results, so you can easily see and compare the compute that best matches your requirements.

Learn More

Best Source of Compute

With a deep understanding of infrastructure and performance, from the leading public cloud providers, YellowDog’s Best Source of Compute algorithms help businesses make smarter decisions about what infrastructure is used to deliver compute-intensive workloads.

Simply set your compute constraints and preferences and allow our intelligent provisioning strategies to automatically select the Best Source of Compute for your workload. The technology pulls data from the YellowDog Index to understand the computing resource that most closely matches your workload’s unique requirements, across a varied list of attributes, so you can manage cost, performance, and environmental impact.

With the Best Source of Compute, you can make more informed choices, which are determined on a workload-by-workload basis, rather than being led by policy constraints or the company’s default settings.

The best bit? This is a layer of insight you can opt to use as you wish. Built into the Platform, the Best Source of Compute is an enhanced feature that puts you firmly in control.

Key Features

YellowDog executes workloads in the cloud end-to-end. Workload management, resource provisioning, and data capture from the provider’s object store, all occur without ever leaving the YellowDog environment. Key features include:

  • Cloud native scheduler providing automated task management, allocation, and resource co-ordination.
  • Cloud computing and Object Store connectors for all major cloud providers.
  • Direct API, Java and Python clients to integrate with leading workload managers including IBM Spectrum Symphony and Slurm.
  • Intuitive and easy-to-use User Portal for configuration, monitoring, reporting and analytics.
  • Keyrings for secure and audited Identity Access and Management across all public clouds.
  • Cloud native design to ensure optimum fault tolerance, scalability and performance.

Use Cases

Workload Management

Coordinate and monitor workload execution across all compute types and automatically manage compute resource levels.

Data-Led Compute Provisioning

Ensure compliance with provisioning strategies that are influenced by user-defined resource attributes and insight from the YellowDog Index.

Best Source of Compute

Improve performance by automatically selecting the most effective computing resource available for your workload's specific needs.

Resource Management

Manage cloud resources regardless of provider, location, or type through our intuitive User Portal, API or Java and Python SDKs.

Multi-Cloud Abstraction

Overcome the complexity of multiple providers, regions, and resource types by viewing the cloud through a single management pane.

Increase On-Premise Efficiency

Lower total cloud costs with more efficient utilisation of your existing
on-premise infrastructure.

“The professional and timely manner of this collaboration has enabled OMass to rapidly screen a novel target and help the company in its’ ambition to build a pipeline of small molecule therapeutics.”

Giles Brown
Giles Brown VP, Head of Medicinal Chemistry, OMass

“YellowDog have transformed how we use our existing hardware and the cloud, making all the behind the scenes workload management invisible.”

Jago Westmacott
Jago Westmacott CTO, Fulcrum Asset Management

“Having the YellowDog Platform there for us on demand really was priceless.”

Alex Sherwood
Alex Sherwood CEO, Giant Animation

“We know exactly how many machines we get, how many hours we use, and how powerful every machine is. So we have total clarity on our available compute.”

Rob Walsh
Rob Walsh Head of Visualisation, PriestmanGoode

User Videos

Learn how to use the YellowDog Platform with our library of user videos.

Documentation

Access useful information about the YellowDog Platform here.

YellowDog Please upgrade your browser

You are seeing this because you are using a browser that is not supported. The YellowDog website is built using modern technology and standards. We recommend upgrading your browser with one of the following to properly view our website:

Windows Mac

Please note that this is not an exhaustive list of browsers. We also do not intend to recommend a particular manufacturer's browser over another's; only to suggest upgrading to a browser version that is compliant with current standards to give you the best and most secure browsing experience.