We compute a low-rank approximation matrix \(\hat{R} = (\hat{R}_{ij})_{m \times n} = U \ast V^T\), where U and V are the usual feature matrix cropped to k features. Weighted low-rank aims to determine \(\hat{R}\) such that minimizes the Frobenius loss of the following objective function:
\(\mathcal{L}(\hat{R}) = \mathcal{L}(U, V) = \sum_{ij} W_{ij} (R_{ij} - U_i \ast V_j^T)^2 + \lambda \ast (\|U_i\|_F^2 + \|V_i\|_F^2)\)
The regularization term weighted by \(\lambda\) is added to prevent over-fitting. The expression \(\|.\|_F\) denotes the Frobenius norm.
The alternated least square algorithms optimization process solves partial derivatives of \(\mathcal{L}\) with respect to each entry \(U\) and \(V\), \(\frac{\partial \mathcal{L}(U,V)}{\partial U_i} = 0\) with fixed \(V\) and \(\frac{\partial \mathcal{L}(U,V)}{\partial V_j} = 0\) with fixed \(U\), to compute \(U_i\) and \(V_i\). Then \(U\) and \(V\) are initialized with random Gaussian numbers with mean zero and small standard deviation and are updated until convergence. The matrix \(W = (W_{ij})_{m \times n} \in \mathbb{R}_+^{m \times n}\) is a non-negative weight matrix that assigns confidence values to observations (hence the name weighted ALS). Each update loop was highly vectorized for performance issues. Rong et al. propose three weighing schemes for the unknown entries \(W_{ij}\).
| Scheme name | Weight scheme | Details |
|---|---|---|
| Uniform(uni) | \(W_{ij} = \delta\) | Missing entries are set to a fixed value \(\delta\). |
| User-oriented(uo) | \(W_{ij} \propto \sum_j R_{ij}\) | A higher confidence is assumed for users that have a lot of ratings. It assumes that a user that has a lot of ratings knows properly the catalog and have discarded items with a higher probability. |
| Item-oriented(io) | \(W_{ij} \propto m - \sum_i R_{ij}\) | If an item has less positive examples the missing data for this item is negative with higher possibility. |
To train a model using this algorithm:
wALS <- rrecsys(smallML, "wALS", k = 5, lambda = 0.01, scheme = "uni", delta = 0.04)
wALS
k is he number of features, lambda the learning rate and scheme is one of the three proposed schemes (values: “uni”, “uo”, or “io”) and delta is the value used in the uniform scheme.
The returned object is of type wALSclass.
To configure the updater to a specific number of loops:
setStoppingCriteria(nrLoops = 10)
Default value is set to 10. The threshold controller configuration:
setStoppingCriteria(autoConverge = TRUE, deltaErrorThreshold = 1e-5, minNrLoops = 10)
Default values are given in the above call to the method.
The method uses the global environment and a configuration will be the same for all three algorithms that require this kind of iteration.
To get more details about the slots read the reference manual.