Terahertz difference frequency generation in diamond