H100 GPU instances
Accelerate your AI projects with H100 GPU instances
High-performance for training, inference, and the most demanding data workloads — in a reliable and transparent European cloud.
Why choose NVIDIA H100 GPUs?
Powerful
Up to 4× faster than A100 for training complex AI models and content generation.
High performance.
The FP8 Transformer Engine optimizes computation for LLMs and GenAI, providing significant performance and energy gains.
compatible
Fully compatible with CUDA, PyTorch, TensorFlow, and JAX: leverage your existing optimizations without adaptation.
Sovereign
Available in our Public Cloud, ensuring flexibility, transparency, and European compliance.
Optimised for your AI & Data workloads
Training and inference of LLMs
Accelerate your models up to 70B parameters (Llama 2, Mistral, Falcon, etc.) with the power of the Transformer Engine and the memory bandwidth of the H100.
Multimodal generative AI
Create, train, and deploy your large-scale image, audio, and video generation models seamlessly.
Data Science & HPC
Optimise your intensive computations: simulations, scientific modelling, or massive parallel processing — with consistent performance and low latency.
SPECIFICATIONS
Technical specifications
GPU
1, or 4 GPUs per instance
GPU memory
80 GB of ultra-fast HBM3 per GPU
High-performance storage
Local NVMe Passthrough on most instances
Public & private network
Up to 25 Gbps included
Automation
Management via your customer space, API, OVHcloud CLI, ...
Secure and Private
Certifications: ISO27001, SOC, Health data.
Maximise your ROI with flexible GPU infrastructure
Pricing transparency
Pay only for the resources you use, with no hidden fees. You maintain control of your costs while enjoying optimal performance.
Instant scalability
Scale your GPU resources on demand, in just a few clicks. Easily adapt your capacity to your AI and data workloads.
Sovereignty and compliance
Your data is hosted on a certified European cloud, ensuring security, transparency, and compliance with regulations (GDPR, ISO, HDS).
Barrier-free accessibility
H100 GPUs accessible to all: from proof of concept to production deployment, with no volume commitment or hardware constraints.
How to choose your GPU for inference?
Compact models
With up to 7B parameters, an A100 offers an excellent performance/price ratio.
Intermediate LLMs
With up to 30B, the H100 is the best balance between speed, energy efficiency, and framework compatibility.
Large models
From 65B+ or extended context windows, the H200 provides the memory bandwidth needed for stable response times.
Configure your GPU instances
Your questions answered
What SLA does OVHcloud guarantee for a GPU instance?
The SLA guarantees 99.99% monthly availability on GPU instances. For further information, please refer to the Terms and Conditions.
Which hypervisor is used for instance virtualisation?
Just like other instances, GPU instances are virtualised by the KVM hypervisor in the Linux kernel.
What is PCI Passthrough?
Cards with GPUs are served via the physical server’s PCI bus. PCI Passthrough is a hypervisor feature that allows you to dedicate hardware to a virtual machine by giving direct access to the PCI bus, without going through virtualisation.
Can I resize a Cloud GPU instance?
Yes, Cloud GPU instances can be upgraded to a higher model after a reboot. However, they cannot be downgraded to a lower model.
Do GPU instances have anti-DDoS protection?
Yes, our anti-DDoS protection is included with all OVHcloud solutions at no extra cost.
Can I switch to hourly billing from an instance that is billed monthly?
If you have monthly billing set up, you cannot switch to hourly billing. Before you launch an instance, please take care to select the billing method that is best suited to your project.
What is a Cloud GPU?
A Cloud GPU is a cloud computing service that provides graphic processing units (GPUs) for tasks that require high computing power. Examples of these tasks are graphic rendering, machine learning, data analysis, and scientific simulations. Unlike on-premises GPUs, which require a significant investment in hardware, cloud GPUs are more flexible and easier to scale. Users can access high-performance computing resources on demand, and only pay for what they use.
What is an H100 and A100 server?
Servers that are equipped with NVIDIA H100 and A100 GPUs are purpose-built to offer exceptional performance in HPC, AI, and data analytics.
What is NGC?
NVIDIA GPU Cloud (NGC) is a cloud computing platform offered by NVIDIA. It provides a comprehensive selection of software that is optimised for GPU acceleration in AI, ML, and HPC applications. NGC simplifies and speeds up the deployment of AI and scientific computing applications. It does this by providing containers, pre-trained models, SDKs, and other tools that are optimised to leverage NVIDIA GPUs.
Why use a Cloud GPU?
There are several advantages to using a Cloud GPU, especially for companies, researchers, and developers in demanding areas such as artificial intelligence (AI), graphics rendering, machine learning (ML), and high-performance computing (HPC).