You must remember that Scribus SLA file contains only layout data and text. All bitmaps are linked externally in Scribus, but are attached to PDF file.
PDF settings are magic of file size. You can set up PDF for web and get few times smaller file than if you set up PDF for printing or editing.