Create the set of sidebars you want to display

Each page can have different sidebar

Right Sidebar

From admin panel you can create unlimited number of sidebars and then display them on different pages based on your needs.

Here is a sample screenshot:

Sidebar Creation

Left Sidebar
Extra Sidebars

Extra Sidebars

Left sidebar. You can choose which sidebar to display as they will appear in select list