Skip to main content

Model reference — Audio

AI models for Noise suppression / speech enhancement

Noise suppression removes what is behind the voice — traffic, fans, keyboards, room echo, crowd noise — and speech enhancement goes further, restoring a recording that was quiet, distorted or clipped so it becomes clear.

There are two reasons to do it and they pull in different directions. Cleaning audio for a person to listen to is judged by how pleasant it sounds. Cleaning audio for a transcription model is judged only by whether the transcript improves — and aggressive cleaning can make transcription worse, by removing parts of the speech signal along with the noise. So enhancement is always measured against the actual downstream purpose, not on how clean the result sounds.

Noise suppression / speech enhancement service AI models for audio files

Input type — Audio

Models in this group take an audio file as input: a recording, a call, an interview or a broadcast. Each specification table gives three hardware tiers — Minimum, the smallest setup on which the model runs correctly; Medium, the usual production configuration; and High, a configuration sized for peak volume. The rate is the number of sample inputs processed per hour on that hardware. Use these rates for initial sizing. Before production, benchmark your own data to validate accuracy, latency, throughput and cost. The sample input here is one hour of 16 kHz mono speech.

DeepFilterNet 3

Vendor: Friedrich-Alexander-Universität

What it does: removes steady background noise in real time with very little computing power, small enough to run alongside a live call on ordinary hardware. The usual default for live audio.

RequirementMinimumMediumHigh
GPU typeRTX 3060RTX 4090A100 80 GB
VRAM4 GB24 GB80 GB
vCPUs4824
RAM8 GB32 GB64 GB
Server1× RTX 3060 12 GB1× RTX 4090 24 GB1× A100 SXM 80 GB
Rate (audio hours processed per hour)≈ 200≈ 700≈ 1,800

RNNoise

Vendor: Xiph.Org Foundation

What it does: a classical noise suppressor needing no GPU at all. Less effective than the model-based options on difficult noise, but effectively free and dependable on a fan or hum.

RequirementMinimumMediumHigh
GPU typeNo GPU requiredNo GPU requiredNo GPU required
VRAM
vCPUs2416
RAM4 GB8 GB32 GB
ServerCPU instance, 2 vCPUCPU instance, 4 vCPUCPU instance, 16 vCPU
Rate (audio hours processed per hour)≈ 400≈ 1,200≈ 4,000

Resemble Enhance

Vendor: Resemble AI

What it does: repairs badly damaged recordings — quiet, distorted, echoing — and rebuilds speech detail rather than merely removing noise. The choice for archive material that must be made listenable.

RequirementMinimumMediumHigh
GPU typeRTX 3090RTX 4090A100 80 GB
VRAM12 GB24 GB80 GB
vCPUs81224
RAM32 GB48 GB96 GB
Server1× RTX 3090 24 GB1× RTX 4090 24 GB1× A100 SXM 80 GB
Rate (audio hours processed per hour)≈ 8≈ 30≈ 80

MetricGAN+ (SpeechBrain)

Vendor: SpeechBrain

What it does: enhances speech optimising directly for perceived quality, which makes it a good fit where a person will listen to the result rather than a machine.

RequirementMinimumMediumHigh
GPU typeRTX 3060RTX 4090A100 80 GB
VRAM6 GB24 GB80 GB
vCPUs4824
RAM16 GB32 GB64 GB
Server1× RTX 3060 12 GB1× RTX 4090 24 GB1× A100 SXM 80 GB
Rate (audio hours processed per hour)≈ 40≈ 150≈ 400

Demucs v4

Vendor: Meta

What it does: separates the recording into speech and everything else, then keeps the speech. Heavier than a noise suppressor but far better where the interference is music or another voice rather than steady noise.

RequirementMinimumMediumHigh
GPU typeRTX 3090RTX 4090A100 80 GB
VRAM12 GB24 GB80 GB
vCPUs81224
RAM32 GB48 GB96 GB
Server1× RTX 3090 24 GB1× RTX 4090 24 GB1× A100 SXM 80 GB
Rate (audio hours processed per hour)≈ 6≈ 24≈ 60

Choosing between them

Which model helps depends on the kind of noise, the recording channel and what the audio is for. Our consultants test the candidates on your own recordings, measuring listening quality or transcription accuracy as appropriate, and recommend the one that improves your outcome rather than the one that sounds cleanest.

At the start of a project we may run a short proof of concept on a sample of your own data, measuring the accuracy and the throughput the model actually achieves on your material. That replaces the estimates on this page with real figures, so the cost and the schedule for the full engagement are known before it is committed.

Noise suppression / speech enhancement service AI models for audio files Pricing

From benchmark to production

Share a representative sample, expected volume, latency target and deployment location for Noise suppression / speech enhancement. We benchmark the shortlisted models, recommend the lowest-cost GPU configuration that meets the target, and scale it from pilot capacity to a dedicated production cluster.