I had similar issues. I noticed that "windows audio device graph isolation" was taking up a large portion of my processor usage. Turns out I had both Nvidia and realtek audio drivers installed. After uninstalling one it fixed my problem.
To add to it. I would really only got frame drops when me or someone else was shooting, so the audio from the gun shots was causing my problems with the audio drivers taking up most of my processor usage.