I always saw the algorithm transform its objective function by log. I wonder this is because logarit

ScommaMaruj

ScommaMaruj

Answered question

2022-07-08

I always saw the algorithm transform its objective function by log. I wonder this is because logarithm function is monotonically increased (logx) to do maximization, or decreased (−logx) to do minimization? So for MM algorithm, any functions should be transformed into log?

Are there also other reasons that log transformation is often used? I wonder log is always work or we have some mathematical operations that can replace log for this purpose?

Answer & Explanation

persstemc1

persstemc1

Beginner2022-07-09Added 18 answers

The logarithm is used for the "logarithmic derivative" trick, which turns products into sums. This is useful because the functions to optimize are often products, often with exponentials, and detection of the extrema requires differentiation.
( log a b c ) = ( a b c ) a b c = a a + b b + c c
is more manageable than a b c + a b c + a b c when the factors are complex.
Crystal Wheeler

Crystal Wheeler

Beginner2022-07-10Added 4 answers

I think another reason is that by employing products, the floating-point numbers are a bit out of control for precise calculations; small numbers get smaller and underflow may occur.

Do you have a similar question?

Recalculate according to your conditions!

New Questions in High school geometry

Ask your question.
Get an expert answer.

Let our experts help you. Answer in as fast as 15 minutes.

Didn't find what you were looking for?