Solution of SVD difference is very high between commons-math3 and ojalgo libraries. Is there any way to reduce the difference based on any input params.
double[][] olsColumns = { { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 },
{ 1.0, 1.0 }, { 1.0, 1.0 }, { 1.0, 1.0 } };
double[] observationVector = { 1.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.0, 1.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,
0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,
0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,
0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,
0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0 };
//Ojalgo
final PrimitiveDenseStore tmpOriginal = PrimitiveDenseStore.FACTORY.rows(olsColumns);
SingularValue<Double> tmpSVD = SingularValue.make(tmpOriginal);
tmpSVD.decompose(tmpOriginal);
double[] singularValues = tmpSVD.getSingularValues().toRawCopy1D();
double[][] V = tmpSVD.getQ2().toRawCopy2D();
System.out.println("V" + Arrays.deepToString(V));
System.out.println("Singular values" + Arrays.toString(singularValues));
try {
// MatrixStore<Double> doubleMat = tmpSVD.solve(tmpOriginal,
// PrimitiveDenseStore.FACTORY.column(Utils.prepareObservationVector()));
MatrixStore<Double> solution = tmpSVD.getSolution(PrimitiveDenseStore.FACTORY.column(observationVector),
tmpSVD.preallocate(tmpOriginal));
System.out.println("Solution " + Arrays.toString(solution.toRawCopy1D()));
} catch (Exception e) {
e.printStackTrace();
}
//Commons-Math3
RealMatrix newPredM = new Array2DRowRealMatrix(olsColumns);
SingularValueDecomposition svd = new SingularValueDecomposition(newPredM);
// RealMatrix covariance = svd.getCovariance(0);
// System.out.println("covariance"+Arrays.deepToString(covariance.getData()));
System.out.println("V" + Arrays.deepToString(svd.getV().getData()));
System.out.println("Singular values" + Arrays.toString(svd.getSingularValues()));
double[] solution = svd.getSolver().solve(new ArrayRealVector(observationVector)).toArray();
System.out.println("Solution" + Arrays.toString(solution));
Commons Math3 Solution: [0.01612903225806451, 0.016129032258064502]
OjAlgo Solution Solution: [7.614155324982286E13, -7.614155324982295E13]
Which version of ojAlgo are you using?
When I try that code I get an exception because the "preallocated" matrix you supply to the tmpSVD.getSolution(...) method is the wrong size/shape. If you simply remove that second argument the allocation is done for you and the code works. I get this result:
V[[0.707106781186548, -0.707106781186547], [0.707106781186547, 0.707106781186548]]
Singular values[13.638181696985853, 9.035878689445474E-15]
Solution [0.016129032258064484, 0.01612903225806446]