I don't know much from your description. There's an awful lot of different "metal to metal" noises, like clank, clunk, grinding, squealing, pots & pans rattling, train wrecks etc. etc. etc. Some further info would help, maybe...
You say it has an exhaust brake. That's what slows the vehicle on a downshift. If it quits slowing on a downshift and freewheels, well, sounds like an exhaust brake failure. You didn't say which exhaust brake, or how it's actuated, like vacuum, hydraulic, pressurized air, mechanical, electric etc. Is it automatically actuated whenever the vehicle decelerates or what?
Whatever, my wild guess is the exhaust brake isn't holding its actuation, and re-actuates when clutch is depressed and released again.
You say it has an exhaust brake. That's what slows the vehicle on a downshift. If it quits slowing on a downshift and freewheels, well, sounds like an exhaust brake failure. You didn't say which exhaust brake, or how it's actuated, like vacuum, hydraulic, pressurized air, mechanical, electric etc. Is it automatically actuated whenever the vehicle decelerates or what?
Whatever, my wild guess is the exhaust brake isn't holding its actuation, and re-actuates when clutch is depressed and released again.