By default WSPBuilder puts all referenced assemblies from the Setup project into GAC. I use the following to control that behaviour:
Set the output directories of the dependent assemblies to either 80\bin or GAC in the setup project.
The assemblies that some where referenced in a dependent assembly that should not be deployed: Reference in Setup project [...]