The music played as the wedding party is leaving the wedding ceremony is known as the recessional.

The word recessional is oftentimes used to describe the actual recession (and not the music).

Merriam-Webster Online Dictionary
recessional (adjective)
of or relating to a withdrawal
recessional (noun)
a hymn or musical piece at the conclusion of a service or program
- recession
« View Entire Wedding Glossary