the key insights behind high-performance computing and (certain kinds) of NLP is that you need to move the data to the computation and do it over a cliuster of machines. you also need to write code in languages such as C++ or C.
here in Edinburgh for our most demanding jobs, we use Hadoop:
we are not alone here; i think you will find that serious groups do likewise.
Miles
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.