What is Sharpness-Aware Minimization (SAM)?

Introduction Consider the general machine learning set-up. We have a class of models parameterized by (e.g. for linear regression, would be the coefficients of the model). Each of these models takes in some input and outputs a result . We want to select the parameter which minimizes some population loss: where is the loss incurred […]

What is Sharpness-Aware Minimization (SAM)?
Advertisement

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s