Dialogue

Because of drastic changes in microphone placement from one shot to another, excessively “live” acoustics, background noise, and other difficulties, part or all of the dialogue in a scene may have to be added during postproduction. Production sound is used as a cue or guide track for replacing dialogue, a procedure commonly known as dubbing, or looping. Looping involves cutting loops out of identical lengths of picture, sound track, and blank magnetic film. The actor listens to the cue track while watching the scene over and over. The actor rehearses the line so that it matches the wording and lip movements and then a recording is made. The cutting of loops has largely been replaced by automatic dialogue replacement (ADR). Picture and sound are interlocked on machines that can run forward or backward. In the 1980s digitalized systems were developed that could, with imperceptible changes in pitch, stretch or shrink the replacement dialogue to match the waveforms in the original for perfect lip sync.

Dubbing also refers to the process of substituting one language for another throughout the entire picture. If this is to be done credibly, it is necessary to make the speech in the second language fit the character and cadence of the original. If the actor’s face is visible in the picture it is also necessary to fit the words of the translation so that the lip movements are not too disparate. In the United States and England pictures intended for foreign distribution are prepared in a version with an M&E (music and effects) track separate from the dialogue to facilitate dubbing. In certain other countries, notably Italy, most dialogue recorded during production is meant merely to serve as a guide track, and nearly all sound is added during postproduction. One last form of speech recorded separately from photography is narration or commentary. Although images may be edited to fit the commentary, as in a documentary using primarily archival footage, most narration is added as a separate track and mixed like sound effects and music.

Sound effects

All sounds other than speech, music, and the natural sounds generated by the actors in synchronous filming are considered sound effects, whether or not they are intended to be noticed by the audience. Although some sounds may be gathered at the time of shooting, the big studios and large independent services maintain vast libraries of effects. Still other effects may be generated by re-creating conditions or by finding or creating substitute noises that sound convincing.

An expedient way of generating mundane effects is the “Foley” technique, which involves matching sound effects to picture. For footsteps, a Foley artist chooses or creates an appropriate surface in a studio and records the sound of someone moving in place on it in time to the projected image. Foleying is the effects equivalent of looping dialogue.

Background noise (room tone or presence) from the original location must be added to all shots that were not recorded live so that there is continuity between synchronous and postsynchronized shots. Continuous noises, such as wind or waves, may be put on separate tracks that are looped (the beginning of a track is spliced to follow its end), so that the sound can be run continuously.

Sound effects can be manipulated with the use of digital technology known as audio signal processing (ASP). The sound waveform is analyzed 44,000 times per second and converted into binary information. The pitch of a sound may be raised or lowered without altering the speed of the tape transport. Thus, engineers can simulate the changes in pitch perceived as an object, such as an arrow or vehicle, approaches and passes the camera. Sounds may be lengthened, shortened, or reversed without mechanical means. Some digital systems enable engineers not only to alter existing sounds but also to synthesize new sound effects or music, including full symphonic scores.

Music

There are two basic kinds of music; underscoring is usually background orchestration motivated by dramatic considerations, and source music is that which may be heard by the characters. Neither is likely to be recorded during shooting. Because a performance is usually divided into separate shots that take minutes or hours to prepare, it would be extremely difficult to produce a continuous musical performance. Thus, most musical numbers are filmed to synchronize with a playback track. The songs and accompaniment are prerecorded, so that during filming the musician is mouthing the words or faking the playing in time to the track recorded earlier.

Whether music is chosen from music libraries or specially composed for the film, it cannot be prepared until the picture has been edited. The first step in scoring is spotting, or deciding which scenes shall have music and where it is to begin and end. The music editor then uses an editing console to break down each use of music, or cue, into fractions of seconds. Recording is done on a recording stage, with individual musicians or groups of instruments miked individually and separated from one another, sometimes by acoustical partitions. In this case the conductor’s function of balancing the instrumentalists may be left to the scoring mixer, who can adjust each track later.