Consider an optimization problem in standard form: with the variable . Let be the domain for , i.e. the intersection of the domains of the ‘s and the ‘s. Let denote the optimal value of the problem. The Lagrange dual function is the function defined as the minimum value of the Lagrangian over : The […]Lagrange dual, weak duality and strong duality
This is a spinoff from the previous post. In that post, we remarked that whenever one receives a new piece of information , the prior odds ratio between an alternative hypothesis and a null hypothesis is updated to a posterior odds ratio , which can be computed via Bayes’ theorem by the formula where is […]A Bayesian probability worksheet
An unusual lottery result made the news recently: on October 1, 2022, the PCSO Grand Lotto in the Philippines, which draws six numbers from to at random, managed to draw the numbers (though the balls were actually drawn in the order ). In other words, they drew exactly six multiples of nine from to . […]What are the odds?
The strong law of large numbers (SLLN) is usually stated in the following way: Theorem: For such that the ‘s are independent and identically distributed (i.i.d.) with finite mean , as , What if the ‘s are independent but not identically distributed? Can we say anything in that setting? We can if we add a […]Kolmogorov’s strong law of large numbers