← Gazillion Industries/Reading material
Formant shifting
Gazillion Industries ·
You pitch a soul vocal up four semitones to fit the beat, and a grown
woman turns into a cartoon. The notes are right. The person is gone.
Formants are the fixed resonances of a voice's throat and mouth, and they are what tell you
the size of the speaker and which vowel they are saying. Pitch is how fast the vocal folds are
vibrating. Move a recording's pitch without moving the formants and the voice stays the same
person singing higher; move both together, which is what speeding a tape up does, and the
speaker appears to shrink. Formant shifting is the control that separates the two.
The short version
- Pitch
- the rate of the vocal folds: the note
- Formants
- resonances of the vocal tract: the vowel and the size
- Together
- speeding up moves both, so the singer shrinks
- Separate
- pitch shifting with formant correction keeps the person
- Shift down
- bigger, older, heavier
- Shift up
- smaller, younger, cartoon at the extremes
What a formant is
The vocal folds produce a buzz full of harmonics. The throat, mouth and nose then act as a
set of resonant chambers that boost some of those harmonics and suppress others, and the peaks
that result are the formants. The first two do most of the work of telling vowels apart: in a
typical adult male voice the "ee" in "beet" sits around 270 and 2300 Hz, while the "ah" in
"father" sits nearer 730 and 1100 Hz. The exact numbers vary with the speaker's size, which is
the whole point.
Those peaks stay roughly where they are when a singer changes note. A tenor holding a vowel
up an octave still sounds like a tenor, because the mouth did not get smaller. A sample played
faster does not have that luxury: every frequency in it moves, formants included, so the ear
computes a smaller throat and hands you a chipmunk.
How to use it
- Pitch the sample where the music needs it first, and leave formants alone.
- If the voice now sounds like a different, smaller person, shift the formants down.
- Start by moving them the opposite way to the pitch, by about the same amount.
- Adjust by ear on a held vowel: the vowel should sound the same, only higher.
- For character rather than correction, move formants without moving pitch at all.
- Check consonants: heavy formant moves make S and T sounds artificial first.
Going the other way is a production tool on its own. Formants down with the pitch untouched
gives you the voice of somebody much larger without turning the melody into a drone, which is why
it shows up on every villain ad-lib since about 2011. Up without pitch gives a thin, nasal,
slightly uncanny read that sits well under a mix because it occupies almost no low end.
SKRUU moves
pitch and time independently: PITCH runs from −20% to +10% in 128 states and reads out in
semitones as well as speed, so you can hear where the character starts to change and stop
there.
When you want the chipmunk
Half the records people love are built on formants moving with the pitch. Soul vocals sped up
until they stop being sung and start being an instrument have carried entire catalogs, and the
small-throat artifact is the signature, not a mistake to be corrected.
Chipmunk soul is the whole method, and it is worth
knowing which of the two you are doing before you reach for a correction knob.
Where it costs you
Formant processing is analysis and resynthesis, so it has artifacts. Big shifts thin out
breath and sibilance, and on a busy stereo mix rather than a single voice they smear. It also
fights with the rest of the chain: a formant-shifted vocal that sounded convincing solo can
reveal its edges once a compressor lifts the quiet parts. And correcting a pitched-up sample all
the way back often costs you the reason you pitched it up in the first place.
Questions people ask
What does formant shifting mean?
Moving the resonant peaks of a voice up or down without changing the note being sung. It
changes the apparent size and character of the speaker while leaving the melody where it was.
Does formant shifting change pitch?
No. Pitch is the rate of the vocal folds and formants are the resonances on top of it. A
formant shifter moves the second without touching the first, which is why a formant-shifted
vocal still sings the same notes.
What is the difference between formants and pitch?
Pitch is the note. Formants are the peaks in the spectrum that tell you which vowel it is and
how big the person saying it is. Two singers on the same note sound different largely because
their formants are in different places.
What is the best vocal formant shifter?
The one in your DAW is usually good for a couple of semitones, which covers most corrective
work. Dedicated tools hold together further out, but past about five semitones every method
starts sounding processed, so plan the take rather than the plugin.
What SKRUU does
SKRUU is two knobs that do not touch each other. PITCH moves the pitch and
TIME moves the length: speed it up while pitching down, or the other way round,
and lock either one while you play the other. PITCH runs from −20% to +10% in 128 states
and reads out in semitones as well as speed, with unity marked; TIME runs from −50% to +25%
and moves nothing but the length. The display is a pitch comparator in semitones, what went in
against what came out, so how far off the record you are is a picture rather than a number you
have to trust.
The notes were always right. Now you get to decide who is singing them.
Keep reading
SKRUU — varispeed pitch and time stretch for Mac and Windows. Pitch and
time move independently, with sixteen elastic return shapes.
Hear it — $29