← Gazillion Industries/Reading material

Formant shifting

Gazillion Industries ·

You pitch a soul vocal up four semitones to fit the beat, and a grown woman turns into a cartoon. The notes are right. The person is gone.

Formants are the fixed resonances of a voice's throat and mouth, and they are what tell you the size of the speaker and which vowel they are saying. Pitch is how fast the vocal folds are vibrating. Move a recording's pitch without moving the formants and the voice stays the same person singing higher; move both together, which is what speeding a tape up does, and the speaker appears to shrink. Formant shifting is the control that separates the two.

The short version

Pitch
the rate of the vocal folds: the note
Formants
resonances of the vocal tract: the vowel and the size
Together
speeding up moves both, so the singer shrinks
Separate
pitch shifting with formant correction keeps the person
Shift down
bigger, older, heavier
Shift up
smaller, younger, cartoon at the extremes

What a formant is

The vocal folds produce a buzz full of harmonics. The throat, mouth and nose then act as a set of resonant chambers that boost some of those harmonics and suppress others, and the peaks that result are the formants. The first two do most of the work of telling vowels apart: in a typical adult male voice the "ee" in "beet" sits around 270 and 2300 Hz, while the "ah" in "father" sits nearer 730 and 1100 Hz. The exact numbers vary with the speaker's size, which is the whole point.

Those peaks stay roughly where they are when a singer changes note. A tenor holding a vowel up an octave still sounds like a tenor, because the mouth did not get smaller. A sample played faster does not have that luxury: every frequency in it moves, formants included, so the ear computes a smaller throat and hands you a chipmunk.

How to use it

  1. Pitch the sample where the music needs it first, and leave formants alone.
  2. If the voice now sounds like a different, smaller person, shift the formants down.
  3. Start by moving them the opposite way to the pitch, by about the same amount.
  4. Adjust by ear on a held vowel: the vowel should sound the same, only higher.
  5. For character rather than correction, move formants without moving pitch at all.
  6. Check consonants: heavy formant moves make S and T sounds artificial first.

Going the other way is a production tool on its own. Formants down with the pitch untouched gives you the voice of somebody much larger without turning the melody into a drone, which is why it shows up on every villain ad-lib since about 2011. Up without pitch gives a thin, nasal, slightly uncanny read that sits well under a mix because it occupies almost no low end.

SKRUU moves pitch and time independently: PITCH runs from −20% to +10% in 128 states and reads out in semitones as well as speed, so you can hear where the character starts to change and stop there.

When you want the chipmunk

Half the records people love are built on formants moving with the pitch. Soul vocals sped up until they stop being sung and start being an instrument have carried entire catalogs, and the small-throat artifact is the signature, not a mistake to be corrected. Chipmunk soul is the whole method, and it is worth knowing which of the two you are doing before you reach for a correction knob.

Where it costs you

Formant processing is analysis and resynthesis, so it has artifacts. Big shifts thin out breath and sibilance, and on a busy stereo mix rather than a single voice they smear. It also fights with the rest of the chain: a formant-shifted vocal that sounded convincing solo can reveal its edges once a compressor lifts the quiet parts. And correcting a pitched-up sample all the way back often costs you the reason you pitched it up in the first place.

Questions people ask

What does formant shifting mean?

Moving the resonant peaks of a voice up or down without changing the note being sung. It changes the apparent size and character of the speaker while leaving the melody where it was.

Does formant shifting change pitch?

No. Pitch is the rate of the vocal folds and formants are the resonances on top of it. A formant shifter moves the second without touching the first, which is why a formant-shifted vocal still sings the same notes.

What is the difference between formants and pitch?

Pitch is the note. Formants are the peaks in the spectrum that tell you which vowel it is and how big the person saying it is. Two singers on the same note sound different largely because their formants are in different places.

What is the best vocal formant shifter?

The one in your DAW is usually good for a couple of semitones, which covers most corrective work. Dedicated tools hold together further out, but past about five semitones every method starts sounding processed, so plan the take rather than the plugin.

What SKRUU does

SKRUU is two knobs that do not touch each other. PITCH moves the pitch and TIME moves the length: speed it up while pitching down, or the other way round, and lock either one while you play the other. PITCH runs from −20% to +10% in 128 states and reads out in semitones as well as speed, with unity marked; TIME runs from −50% to +25% and moves nothing but the length. The display is a pitch comparator in semitones, what went in against what came out, so how far off the record you are is a picture rather than a number you have to trust.

The notes were always right. Now you get to decide who is singing them.

Keep reading

SKRUU — varispeed pitch and time stretch for Mac and Windows. Pitch and time move independently, with sixteen elastic return shapes.

Hear it — $29

Gazillion Industries LLC · reading material