ERROR 2003 (HY000): Can't connect to MySQL server on localhost (10061)

You don't need a restart your windows. The easiest way to achieve this is

1. Goto /bin/
2. Run mysqld (service)
3. close the cmd prompt
4. Run mysql.exe or the better way to do is add the location to PATH environment Variable