Tax for a Contractor working from home

We have a contractor that's working from home. He primarily does work for our company. How does tax work, do we need to submit an IRP5? We've been paying him directly without deducting any PAYE or TAX

Kindly refer to our decision tree on Am I an Independent Contractor?