If you have disallowed the crawling among the site, it's make without doubt you do an audit of it and only disallow those sections of the pages which you don't want s to investigate. Last yet not least, and maybe most greatly important! http://gyeongshin.com/ksen/bbs/board.php?bo_table=free&wr_id=1385868