• The cross-entropy (CE) method is a Monte Carlo method for importance sampling and optimization. It is applicable to both combinatorial and continuous...
    7 KB (1,085 words) - 19:50, 23 April 2025
  • In information theory, the cross-entropy between two probability distributions p {\displaystyle p} and q {\displaystyle q} , over the same underlying...
    19 KB (3,264 words) - 23:00, 21 April 2025
  • the Gibbsian method of statistical mechanics is sound by also arguing that the entropy of statistical mechanics and the information entropy of information...
    31 KB (4,196 words) - 11:16, 14 June 2025
  • Thumbnail for Entropy (information theory)
    2021. Rubinstein, Reuven Y.; Kroese, Dirk P. (9 March 2013). The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation...
    72 KB (10,220 words) - 13:03, 6 June 2025
  • Stochastic optimization (category Monte Carlo methods)
    Battiti, G. Tecchiolli (1994), recently reviewed in the reference book cross-entropy method by Rubinstein and Kroese (2004) random search by Anatoly Zhigljavsky...
    12 KB (1,071 words) - 06:25, 15 December 2024
  • In statistics and information theory, a maximum entropy probability distribution has entropy that is at least as great as that of all other members of...
    36 KB (4,495 words) - 18:46, 19 June 2025
  • Thumbnail for Travelling salesman problem
    optimization, river formation dynamics (see swarm intelligence), and the cross entropy method. This starts with a sub-tour such as the convex hull and then inserts...
    87 KB (11,633 words) - 20:31, 19 June 2025
  • Thumbnail for Simulated annealing
    Simulated annealing (category Optimization algorithms and methods)
    The cross-entropy method (CE) generates candidate solutions via a parameterized probability distribution. The parameters are updated via cross-entropy minimization...
    35 KB (4,641 words) - 11:29, 29 May 2025
  • Thumbnail for Dirk Kroese
    estimation, Monte Carlo methods and rare-event simulation. He is, with Reuven Rubinstein, a pioneer of the Cross-Entropy (CE) method. Born in Wapenveld (municipality...
    5 KB (579 words) - 14:16, 20 May 2025
  • Thumbnail for Ant colony optimization algorithms
    Ant colony optimization algorithms (category Optimization algorithms and methods)
    ACO-type algorithms are closely related to stochastic gradient descent, Cross-entropy method and estimation of distribution algorithm. They proposed an umbrella...
    77 KB (9,484 words) - 10:31, 27 May 2025
  • statistics, the Kullback–Leibler (KL) divergence (also called relative entropy and I-divergence), denoted D KL ( P ∥ Q ) {\displaystyle D_{\text{KL}}(P\parallel...
    77 KB (13,067 words) - 13:07, 12 June 2025
  • I.; Kroese, D.P. (2004). "Global Likelihood Optimization Via the Cross-Entropy Method, with an Application to Mixture Models". Proceedings of the 2004...
    57 KB (7,792 words) - 03:39, 19 April 2025
  • Thumbnail for Reuven Rubinstein
    breakthrough methods, such as the score-function method, the stochastic counterpart method, and the cross-entropy method, which have numerous applications in combinatorial...
    7 KB (611 words) - 03:33, 22 March 2025
  • 2001, "Updating and Estimating a Social Accounting Matrix Using Cross Entropy Methods", Economic Systems Research 13 (1), pp. 47–64. Stone, R. and Brown...
    11 KB (1,486 words) - 09:25, 10 February 2022
  • conditional entropy conditional quantum entropy confusion and diffusion cross-entropy data compression entropic uncertainty (Hirchman uncertainty) entropy encoding...
    1 KB (93 words) - 09:42, 8 August 2023
  • α Cross-correlation Cross-covariance Cross-entropy method Cross-sectional data Cross-sectional regression Cross-sectional study Cross-spectrum Cross tabulation...
    87 KB (8,280 words) - 23:04, 12 March 2025
  • List of algorithms (category Optimization algorithms and methods)
    algorithm Dancing Links: an efficient implementation of Algorithm X Cross-entropy method: a general Monte Carlo approach to combinatorial and continuous multi-extremal...
    72 KB (7,951 words) - 17:13, 5 June 2025
  • In physics, the Tsallis entropy is a generalization of the standard Boltzmann–Gibbs entropy. It is proportional to the expectation of the q-logarithm...
    24 KB (2,881 words) - 17:28, 12 June 2025
  • all principal axes. Estimation of distribution algorithms and the Cross-Entropy Method are based on very similar ideas, but estimate (non-incrementally)...
    46 KB (7,558 words) - 16:28, 14 May 2025
  • clustering Correspondence analysis Cortica Coupled pattern learner Cross-entropy method Cross-validation (statistics) Crossover (genetic algorithm) Cuckoo search...
    39 KB (3,386 words) - 19:51, 2 June 2025
  • (2012-10-12). "Solving the Multidimensional Assignment Problem by a Cross-Entropy method". Journal of Combinatorial Optimization. 27 (4): 808–823. doi:10...
    6 KB (830 words) - 13:34, 13 April 2024
  • computes averages of operators in many-body quantum mechanical problems Cross-entropy method — for multi-extremal optimization and importance sampling Also see...
    70 KB (8,327 words) - 09:12, 7 June 2025
  • Thumbnail for /dev/random
    implement the same methods for /dev/random and /dev/urandom. In older operating systems, /dev/random typically blocked if there was less entropy available than...
    23 KB (2,447 words) - 21:15, 25 May 2025
  • (2020). "Amended Cross Entropy Cost: Framework For Explicit Diversity Encouragement". arXiv:2007.08140 [cs.LG]. "1.11. Ensemble methods". Wolpert (1992)...
    53 KB (6,685 words) - 14:14, 8 June 2025
  • Thumbnail for Dynamic light scattering
    Dynamic light scattering (category Biochemistry methods)
    less than 1:10−5. The Maximum entropy method is an analysis method that has great developmental potential. The method is also used for the quantification...
    35 KB (4,342 words) - 19:42, 22 May 2025
  • y)\,} Despite similar notation, joint entropy should not be confused with cross-entropy. The conditional entropy or conditional uncertainty of X given...
    64 KB (7,973 words) - 23:39, 4 June 2025
  • Thumbnail for Second law of thermodynamics
    principle," in G. J. Erickson and C. R. Smith (eds.)Maximum-Entropy and Bayesian Methods in Science and Engineering, Vol,.1: p. 267. Caratheodory, C....
    107 KB (15,472 words) - 01:32, 4 May 2025
  • Thumbnail for Time series
    Time series (category Mathematical and quantitative methods (economics))
    Correlation entropy Approximate entropy Sample entropy Fourier entropy [uk] Wavelet entropy Dispersion entropy Fluctuation dispersion entropy Rényi entropy Higher-order...
    43 KB (5,025 words) - 15:47, 14 March 2025
  • Thumbnail for Estimation of distribution algorithm
    convergence Dependency Structure Matrix Genetic Algorithm (DSMGA) CMA-ES Cross-entropy method Ant colony optimization algorithms Pelikan, Martin (2005-02-21),...
    27 KB (4,075 words) - 04:21, 9 June 2025
  • bits of entropy. These extra bits of entropy will not apply to other mmap() segments, only libraries. Attackers may make use of several methods to reduce...
    39 KB (4,397 words) - 10:29, 12 June 2025