How hard would it be (if possible) to take a factory clear to a matte finish? Would it be possible to just scuff the clear and add a matte finish clear? Has anyone tried this?

I've never tried it, but it sure sounds reasonable to me. Prep the prior clear as if doing a repair (wet sand with 800-1000 grit or equivalent scuff paste), then re-clear with the matte.