To open a window from an icon, click the icon. For example, point at the My Computer icon and click. If you do it correctly, the My Computer icon opens into the My Computer window.
There is another method you can use to open a window. Just point to the icon and right-click once, and a shortcut menu appears. Select Open from the menu to open the window.