I may be misreading this, but I assume "taskbar" means "dock". If that's the case, go to your dock settings and find the Dock Contents page. Check "Display open windows along with my icons", which I assume is already done since they're showing. Then, just below that, find the drop-down labelled "System Tray/Taskbar Placement. Select "Left side of dock" from that menu.