[BUG]: Sound slows down when accessing the memory card. Open Season [SLUS-21467]

[Loy2up]

Describe the Bug

The game maintains its 100% performance, but the sound jitters when the game accesses the memory card. It is most noticeable when setting the clock rate at 300%. It is the same issue as #11565 and #7316

Reproduction Steps

Start the game, and load or save your game.

Expected Behavior

No sound jitter.

PCSX2 Revision

v2.3.117

Operating System

Windows 11

If Linux - Specify Distro

No response

CPU

AMD Ryzen 7 7800X3D

GPU

Nvidia RTX 4090

GS Settings

No response

Emulation Settings

No response

GS Window Screenshots

No response

Logs & Dumps

No response

[Loy2up]

For future reference, this issue isn't present on PCSX2 1.2.1, but is on PCSX2 1.4 and upwards. Unfortunately, I can't bisect further because I can't find any archive builds between those two.