I am stuck on fixing canonical issue. I found Yoast's .htaccess file, but not understanding what to put in there.
How do I code it into my website?
You need to fix it differently, apparently the thing you're asking is not controlled by Yoast but by Wordpress itself. Follow these steps;