Cooma GPU Cloud

GPU capacity.
Built around your workload.

Train models. Fine-tune for your domain. Run inference in production. Choose GPU virtual machines, bare-metal servers or managed clusters, with flexible short-term reservations and an Australian team supporting your deployment.

Plan your GPU deployment
GPU capacity connected to deployment options Four detailed GPU nodes connect to virtual machines, a dedicated cluster and managed Slurm or Kubernetes workloads. Allocation lights and network signals cycle across the three options. A reservation strip below illustrates capacity booked over time. GPU capacityDeployment options NODE 01 NODE 02 NODE 03 NODE 04 GPU virtual machinesSeparate environmentsVM 1VM 2VM 3 Dedicated clustersConnected GPU nodes Managed workloadsSlurm / Kubernetes Reservation windowsCapacity × duration
Illustrative infrastructure, deployment options and reservation windows.

Built around the work

Train. Adapt. Serve.

Each stage places different demands on compute. Start with the workload, then size the environment.

Model training

Build a cluster plan around model size, dataset and training window. Balance accelerator capacity with communication between nodes and reliable access to training data.

Focus: scale, interconnect, checkpoints

Fine-tuning & research

Adapt models to your domain, compare experiments and evaluate results. Match the environment to your research cycle and the capacity each run needs.

Focus: memory, experiments, project duration

Production inference

Run your model stack on dedicated GPUs. Size capacity around model memory, concurrent requests, response time and the cost of serving your workload.

Focus: latency, throughput, utilisation

Looking for model API access? Explore Cooma TokenFactory

A complete compute environment

Virtual machines.
Bare metal. Managed clusters.

Choose how you want to run. We bring compute, networking, storage and your operating environment together around the workload.

GPU virtual machines

Run development, experiments and AI applications in a GPU-backed virtual environment. Match the GPU, memory, storage and software image to the work your team needs to do.

From a GPU request to an allocated VM

Three VM requests mapped to individual devices on an illustrative host.

Example deployment
  1. 01Request resources
  2. 02Assign devices
  3. 03Start environments
  4. 04Run workloads
VM requestsGPU allocation
dev-01Development1GPURunning
eval-02Evaluation2GPUsRunning
tune-03Fine-tuning4GPUsRunning

Each colour follows one request into the host.

Host 018 GPU devices
G00 G01 G02 G03 G04 G05 G06 G07
CPU / RAMLocal storageNetwork
7 allocated1 unassigned
dev-01 · G00eval-02 · G01–02tune-03 · G03–06
7 GPUs assigned · 1 unassignedIllustrative device assignment. VM sizing and host configuration are agreed for each deployment.

Bare-metal servers & clusters

Dedicated NVIDIA capacity for teams that need control of the full server. Connect multiple nodes for distributed workloads, with network fabric, InfiniBand requirements and storage designed together.

See the data path through a training cluster

Four nodes, two traffic paths and a coordinated training cycle.

Example deployment
  1. 01Read dataset
  2. 02Compute locally
  3. 03Exchange gradients
  4. 04Write checkpoint
4 dedicated nodes8 GPUs / node
Node 01Ranks 00–07
00 01 02 03 04 05 06 07
Node 02Ranks 08–15
00 01 02 03 04 05 06 07
Node 03Ranks 16–23
00 01 02 03 04 05 06 07
Node 04Ranks 24–31
00 01 02 03 04 05 06 07
Compute fabricGradient exchange
InfiniBand requirements scoped
Data & checkpointsRead datasets · write state
32 GPU devices4 rank groupsCheckpoint current operation
Training state is written to storageA four-node training example. Network topology, GPU count and storage are deployment-specific.

Managed Slurm & Kubernetes

Use managed Slurm for scheduled research and training jobs, or managed Kubernetes for containerised AI workloads. Cooma supports the cluster environment, with operating responsibilities and support scope agreed for your deployment.

How jobs move from queue to GPU

A batch-job queue and a three-replica model service, shown side by side.

Example deployment
  1. 01Submit workload
  2. 02Place on workers
  3. 03Complete / start
  4. 04Reuse capacity
SlurmBatch scheduling
train-01Training · 8 GPUsComplete
eval-02Evaluation · 8 GPUsRunning
tune-03Fine-tuning · 8 GPUsRunning
Queue → allocate → complete → reuse
Node 01tune-03
Node 02eval-02

0 waiting · 2 running · 1 complete

KubernetesService placement
serve-01Model service · 1 GPUReady
serve-02Model service · 1 GPUReady
serve-03Model service · 1 GPUReady
Request → schedule → ready
Worker 01
serve-01
1 GPU assigned
Worker 02
serve-02
1 GPU assigned
Worker 03
serve-03
1 GPU assigned

Desired replicas 3 · Ready 3 / 3

tune-03 takes the free node · 3 replicas readyIllustrative scheduler states. Slurm and Kubernetes are separate managed deployment options.

Choose your compute

Choose the GPU.
Design the whole system.

Explore NVIDIA B300, H200 and H100 capacity. We match the platform to your model, then confirm memory, node count, networking and storage.

NVIDIABlackwell Ultra
NVIDIA HGX B300 baseboard
HGX B300 baseboard

B300

Explore Blackwell Ultra for your next training or inference deployment. Discuss model size, precision and the complete server configuration with Cooma.

Enquire about B300
NVIDIAHopper
NVIDIA HGX H200 platform
HGX H200 platform

H200

Explore H200 for workloads where model memory and data movement shape the deployment. We work through the fit for your training, fine-tuning or inference stack.

Enquire about H200
NVIDIAHopper
NVIDIA H100 SXM module
H100 SXM module

H100

Explore H100 for training, experimentation and production inference. Define your node count, interconnect and software requirements with our team.

Enquire about H100

Product imagery: NVIDIA. Exact GPU variant, server specification, location and availability are confirmed in your proposal.

Global infrastructure

The right capacity.
In the right place.

An Australian point of contact, with access to global infrastructure supply. Plan your deployment across North America, Europe and Asia Pacific around data location, connectivity and delivery requirements.

Capacity is sourced through infrastructure providers. The map shows supplier regions; the facility, data boundaries and available capacity are confirmed for your deployment.

Discuss your deployment
North America, Europe and Asia Pacific, Cooma’s supplier regions

Supplier regions · North America · Europe · Asia Pacific

Capacity & economics

Plan for the run.
Prepare for what follows.

Reserve GPUs for a defined project or plan for sustained production. Flexible short-term reservations let you align capacity with training runs, experiments and changing workload needs.

Flexible short-term reservations
Book capacity for a defined training, fine-tuning or evaluation window. Agree the start date, duration and configuration around your project.
Sustained workloads
Plan a longer-running deployment with capacity and operating responsibilities agreed.
Cost clarity
Review compute, storage, networking and support together. Quantities, term options, expansion and any change conditions are set out in your proposal.

Reserve the GPU count and time you need

An example showing how GPU count and duration combine into reserved capacity.

Example deployment
  1. 01Plan the windows
  2. 02Reserve experiment
  3. 03Reserve training
  4. 04Reserve inference
12-day capacity planEach cell = 1 GPU-day
GPU / day010203040506070809101112G01G02G03G04G05G06G07G08
ExperimentTrainingInferenceUnreserved
Reservation windows
Experiment2 GPUs × 2 days4 GPU-days
Training8 GPUs × 4 days32 GPU-days
Inference4 GPUs × 6 days24 GPU-days

60 GPU-days reserved

Add inference: 4 GPUs × 6 days = 24 GPU-daysIllustrative arithmetic, not pricing or a minimum booking term. Actual reservation conditions are agreed in your proposal.

Security & control

The right safeguards.
Clear responsibility.

Start with the sensitivity of your workload and your organisation’s security requirements. Confirm the controls, supporting evidence and responsibilities for the proposed deployment before proceeding.

Physical safeguards

Assess the facilities and hardware behind the capacity.

  • Facility access, visitor procedures and protection against unauthorised physical access.
  • Power, cooling, fire protection and resilience arrangements.
  • Hardware maintenance, storage-media sanitisation and equipment retirement.

Digital controls

Define the boundaries around systems, users and data.

  • Administrator access, authentication requirements and network separation.
  • Encryption requirements, key management, and agreed data storage and processing locations.
  • Logging, vulnerability management, patching and data retention or deletion.

Operational accountability

Make ownership clear across Cooma, providers and your team.

  • Responsibility for facilities, hardware, operating systems, applications and data.
  • Incident notification, escalation, support and recovery arrangements.
  • Available assurance evidence, its scope and any gaps against your requirements.

Controls and assurance vary by provider, location and service. Dedicated bare metal alone does not establish every safeguard. Any certification must be assessed against the organisation, facility and service it actually covers.

Discuss your security requirements

From requirement to deployment

A deployment plan.
A clear commercial scope.

01

Define the workload

Share your model or application, dataset, target performance, preferred region and start date. We turn that brief into compute requirements.

02

Confirm the fit

Review GPU and node counts, memory, network fabric, storage and orchestration. Agree how the environment will be accessed and validated.

03

Agree the delivery

Set the capacity window, price, deployment scope and support ownership. Define acceptance criteria and how changes or expansion will be handled.

Before we talk

The practical
questions.

Do you offer managed Slurm and Kubernetes?

Yes. Cooma offers managed Slurm for scheduled compute jobs and managed Kubernetes for containerised workloads. Configuration, access, monitoring, maintenance and support responsibilities are agreed for each deployment.

Can I reserve GPUs for a short-term project?

Yes. Flexible short-term reservations are available for project workloads. We confirm the GPU configuration, quantity, region, start date, duration and price in your proposal, including any extension or change conditions.

Can I choose GPU virtual machines or bare metal?

Yes. Cooma offers GPU virtual machines and dedicated bare-metal servers, including connected clusters. We match the deployment type to your workload, software stack and level of infrastructure control.

Which locations and GPUs are available?

We work with global rented infrastructure capacity, including H100, H200 and B300 servers. Specific locations, quantities and deployment dates are confirmed against your requirements.

Can I use the servers for training or inference?

Yes. Cooma scopes GPU environments for model training, fine-tuning, research and production inference. We match GPU memory, interconnects, storage and software requirements to the workload before agreeing the deployment.

Who is responsible for security?

Responsibilities depend on the service agreed. Confirm ownership of physical safeguards, server and network access, operating-system patching, application security and data protection before deployment. Support, incident escalation and recovery arrangements also need an agreed owner.

Review the security considerations

How do pricing and support work?

We provide commercial terms for the agreed configuration and duration. Support scope, service responsibilities and any service-level commitments are established for each engagement.

Does Cooma own the data centres shown on the map?

Cooma’s infrastructure offering includes rented bare-metal GPU capacity. Highlighted regions describe areas of focus, not facility ownership or live inventory. Facilities, quantities and availability are confirmed for each engagement.

Can I specify a deployment location or data-residency requirement?

Yes. Include your required location, processing and storage boundaries, access arrangements and timing in the initial discussion. The proposed deployment must be checked against those requirements before capacity is agreed.

Start a conversation

Bring the workload.
Let’s plan the compute.

Tell us what you’re running, your preferred GPUs or node count, location, start date and duration. We’ll work through a configuration and capacity proposal with you.

Request a capacity proposal