SVDLIBC (Sparse SVD, clon of SVDPACK)
Related topics from sci. math.num-analysis
Matrix Inversion Suggestions for Fortran
Unstable Simultaneous Linear Equations!
Sparse Matrix Question
Solving a large sparse system with a single dense row/column?
Solving a large, sparse, nearly symmetric system
Java ready for number crunching?