PETSc algebraic solvers can now use pthreads on Vec and Mat operations. This sometimes provides an alternative to the all MPI approach.

We recommend working with petsc master (git branch) if you want to explore this feature.