Vector processors, or SIMD processors are microprocessors that are specialized for operating on vector or matrix data elements. These processors have specialized hardware for performing vector operations such as vector addition, vector multiplication, and other operations.
Modern graphics processors and GPUs tend to be vector-based processors. Modern Intel-based chips also have SIMD capabilities known as SSE or MMX operations.
Vector processors which perform an instruction on all data elements simultaneously are said to execute in parallel.
Each EX in this image shows a separate execution core (typically an ALU) operating in parallel with one another.