Setting up small business while employed

Can I set up a small business while still employed? The business doesn't do work that conflicts with current employer.

It is fine from a tax perspective as long as you are declaring your business profit and are fully compliant with SARS.
However, you would need to check first with your employer to ensure there is no conflict of interest and nothing prohibiting you from engaging in other work while employed.