Yeah middle of the week is the way to go with most things in CO now unfortunately. It's a weird trail system. The closest thing to another jeep I've seen back there other than a CJ I go with sometimes was a group of broncos. And one guy in a fancy SUV who told me good luck and looked terrified.
Luckily those guys typically stick to the "popular" trails lol. Slaughterhouse, yankee hill, switzerland, rampart