should unpublish question be disable on similar question too?

That is a bug. Please raise the bug in tracker and we will fix it. If you need immediate solution for this follow below steps.

Edit components/com_communityanswers/models/answers.php and at line 306 find below code

$wheres = array();

Add the below code just after the above one

$wheres[] = 'a.published=1';