Even then, it could be nice to have more control over it, something like being able to set a time of inactivity, a threshold of bandwith used (because a torrent that downloads at 1kb/s could be considered inactive.
You do have more control. Go into Settings > Transfers > General, and look near "Auto-manage slots" there is a button marked "Details".
If you click that there are some settings in there, look at the first section "downloadautoskipqueue" and you can change numbers. But be careful, and if you make mistake, use the Load Defaults button at bottom of this window.
But the default settings are good, you just need to give enough time.
Also,
very importantly you need to have the bandwidth incoming throttle set, or using the auto-limit. That is how the queue knows when there is more download ability, because you aren't against throttle. So make sure you have bandwidth auto-limit or you set an incoming limit.