pytorch l1 regularization code example
Example: pytorch l2 regularization
# add l2 regularization to optimzer by just adding in a weight_decay
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)# add l2 regularization to optimzer by just adding in a weight_decay
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)