What factors determine the speed of a programming language?

We often hear X is a faster language than Y. What are the factors that determines the speed of a programming language?