Play around with it and let me know.
I did a ton of work on similar files recently.

Did some tests and found that if you dont want to cause people problems, stick to 5mb max for a viewable on-line PDF or 30mb max for a downloadable file.

Its the color scans that are the killer. I didnt need color so converted what I was doing to black and white. That reduced sizes by 95%.