Elastic Net
It is a combination of ridge and lasso and has the best of both worlds. It is especially useful for:
- Small datasets or when number of columns is comparable to number of records
- Several features are strongly correlated and hence dropping the feature is not possible/preferable.