info@avatto.com
+91-9920808017
0. Consider a vector a ∈ Rn and let b ∈ Rn be the output of the softmax function application to this vector and we have a parameter k such that If k = 1 then we get the default softmax function. Now, for simplicity, let us assume that all elements of a are positive. Further, let us assume that the j-th element of the maximum/largest element of a. It should be obvious that the corresponding element of b will also be the maximum/largest element of b. Now suppose we set k = 2, then what will happen to the j-th entry of b.
It will remain the same as the case when k = 1 because now k = 2 appears in the denominator also
It will be greater than the case when k = 1
It will be lesser than the case when k = 1
Can't say as it will depend on the other values in a
Your email address will not be published. Required fields are marked *
Report
Name
Email
Website
Save my name, email, and website in this browser for the next time I comment.
Comment
Login with Facebook
Login with Google
Forgot your password?
Lost your password? Please enter your email address. You will receive mail with link to set new password.
Back to login
