Convex optimization is a subfield of mathematical optimization that studies the problem of minimizing convex functions over convex sets (or, equivalently...
30 KB (3,170 words) - 11:17, 22 June 2025
generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from...
53 KB (6,165 words) - 15:32, 2 August 2025
Online machine learning (redirect from Online convex optimization)
methods for convex optimization: a survey. Optimization for Machine Learning, 85. Hazan, Elad (2015). Introduction to Online Convex Optimization (PDF). Foundations...
25 KB (4,747 words) - 08:00, 11 December 2024
mathematical optimization, the convex conjugate of a function is a generalization of the Legendre transformation which applies to non-convex functions....
16 KB (2,012 words) - 04:27, 13 May 2025
In geometry, the convex hull, convex envelope or convex closure of a shape is the smallest convex set that contains it. The convex hull may be defined...
58 KB (7,173 words) - 01:04, 1 July 2025
real number). Convex functions play an important role in many areas of mathematics. They are especially important in the study of optimization problems where...
35 KB (5,857 words) - 19:23, 1 August 2025
function) is a convex set. Convex minimization is a subfield of optimization that studies the problem of minimizing convex functions over convex sets. The...
27 KB (3,429 words) - 17:52, 10 May 2025
In mathematical optimization theory, duality or the duality principle is the principle that optimization problems may be viewed from either of two perspectives...
28 KB (3,941 words) - 03:46, 30 June 2025
have the property of being closed and convex. They are important concepts in the fields of convex optimization, variational inequalities and projected...
28 KB (3,941 words) - 12:49, 8 May 2025
Interior-point method (category Optimization algorithms and methods)
linear to convex optimization problems, based on a self-concordant barrier function used to encode the convex set. Any convex optimization problem can...
30 KB (4,691 words) - 00:20, 20 June 2025
Demand optimization Destination dispatch — an optimization technique for dispatching elevators Energy minimization Entropy maximization Highly optimized tolerance...
70 KB (8,327 words) - 09:12, 7 June 2025
Gradient descent (redirect from Gradient descent optimization)
Method for Convex Optimization". SIAM Review. 65 (2): 539–562. doi:10.1137/21M1390037. ISSN 0036-1445. Kim, D.; Fessler, J. A. (2016). "Optimized First-order...
39 KB (5,600 words) - 19:08, 15 July 2025
Frank–Wolfe algorithm (category Optimization algorithms and methods)
optimization algorithm for constrained convex optimization. Also known as the conditional gradient method, reduced gradient algorithm and the convex combination...
8 KB (1,200 words) - 19:37, 11 July 2024
necessarily convex) compact set defined by inequalities g i ( x ) ⩾ 0 , i = 1 , … , r {\displaystyle g_{i}(x)\geqslant 0,i=1,\ldots ,r} . Global optimization is...
18 KB (2,097 words) - 03:46, 26 June 2025
Cutting-plane method (category Optimization algorithms and methods)
In mathematical optimization, the cutting-plane method is any of a variety of optimization methods that iteratively refine a feasible set or objective...
10 KB (1,570 words) - 21:55, 13 July 2025
Nonlinear programming (redirect from Nonlinear optimization)
an optimization problem where some of the constraints are not linear equalities or the objective function is not a linear function. An optimization problem...
11 KB (1,483 words) - 11:39, 15 August 2024
Linear programming (redirect from Linear optimization)
programming (also known as mathematical optimization). More formally, linear programming is a technique for the optimization of a linear objective function, subject...
61 KB (6,690 words) - 17:57, 6 May 2025
Combinatorial optimization is a subfield of mathematical optimization that consists of finding an optimal object from a finite set of objects, where the...
18 KB (1,848 words) - 17:23, 29 June 2025
Quadratic programming (category Optimization algorithms and methods)
(2016), Tuy, Hoang (ed.), "Polynomial Optimization", Convex Analysis and Global Optimization, Springer Optimization and Its Applications, vol. 110, Cham:...
22 KB (1,931 words) - 05:55, 18 July 2025
Ellipsoid method (category Convex optimization)
In mathematical optimization, the ellipsoid method is an iterative method for minimizing convex functions over convex sets. The ellipsoid method generates...
23 KB (3,704 words) - 01:44, 24 June 2025
Discrete optimization is a branch of optimization in applied mathematics and computer science. As opposed to continuous optimization, some or all of the...
2 KB (174 words) - 15:49, 12 July 2024
internationally recognized expert in convex optimization, especially in the development of efficient algorithms and numerical optimization analysis. He is currently...
7 KB (522 words) - 11:45, 24 June 2025
Penalty method (category Optimization algorithms and methods)
In mathematical optimization, penalty methods are a certain class of algorithms for solving constrained optimization problems. A penalty method replaces...
7 KB (922 words) - 15:20, 27 March 2025
Quasiconvex function (redirect from Quasi-convex function)
mathematical analysis, in mathematical optimization, and in game theory and economics. In nonlinear optimization, quasiconvex programming studies iterative...
12 KB (1,436 words) - 21:33, 2 August 2025
Stochastic gradient descent (redirect from Adam (optimization algorithm))
learning rates. While designed for convex problems, AdaGrad has been successfully applied to non-convex optimization. RMSProp (for Root Mean Square Propagation)...
53 KB (7,031 words) - 19:45, 12 July 2025
Conic optimization is a subfield of convex optimization that studies problems consisting of minimizing a convex function over the intersection of an affine...
3 KB (455 words) - 01:57, 8 March 2025
Bayesian optimization is a sequential design strategy for global optimization of black-box functions, that does not assume any functional forms. It is...
21 KB (2,323 words) - 14:01, 8 June 2025
Second-order cone programming (category Convex optimization)
A second-order cone program (SOCP) is a convex optimization problem of the form minimize f T x {\displaystyle \ f^{T}x\ } subject to ‖ A i x + b i...
11 KB (1,559 words) - 19:41, 1 August 2025
Subgradient method (category Convex optimization)
Subgradient methods are convex optimization methods which use subderivatives. Originally developed by Naum Z. Shor and others in the 1960s and 1970s,...
11 KB (1,496 words) - 20:07, 23 February 2025
Quadratically constrained quadratic program (category Mathematical optimization)
In mathematical optimization, a quadratically constrained quadratic program (QCQP) is an optimization problem in which both the objective function and...
7 KB (748 words) - 18:33, 17 July 2025