In probability theory, a piecewise-deterministic Markov process (PDMP) is a process whose behaviour is governed by random jumps at points in time, but...
6 KB (671 words) - 14:56, 31 August 2024
Time reversibility (redirect from Reversed process)
including Lévy processes, stochastic networks (Kelly's lemma), birth and death processes, Markov chains, and piecewise deterministic Markov processes. Time reversal...
8 KB (1,062 words) - 04:49, 22 June 2025
hidden Markov model Maximum-entropy Markov model Variable-order Markov model Markov renewal process Markov chain mixing time Markov kernel Piecewise-deterministic...
2 KB (229 words) - 07:10, 17 June 2024
Autoregressive model (redirect from Autoregressive process)
statistics, econometrics, and signal processing, an autoregressive (AR) model is a representation of a type of random process; as such, it can be used to describe...
34 KB (5,421 words) - 03:27, 4 February 2025
Jump diffusion (category Stochastic processes)
the posterior probability model. Jump process, an example of jump diffusion Piecewise-deterministic Markov process (PDMP), an example of jump diffusion...
5 KB (603 words) - 11:22, 19 March 2025
observable Markov decision process (POMDP) is a generalization of a Markov decision process (MDP). A POMDP models an agent decision process in which it...
22 KB (3,306 words) - 13:42, 23 April 2025
of statistics Pickands–Balkema–de Haan theorem Pie chart Piecewise-deterministic Markov process Pignistic probability Pinsker's inequality Pitman closeness...
87 KB (8,280 words) - 23:04, 12 March 2025
property of the value process. In a 1984 paper he introduced the concept of Piecewise deterministic Markov process, a class of Markov models which have been...
8 KB (678 words) - 10:44, 5 April 2025
Detailed balance (redirect from Reversible Markov process)
balance in kinetics seem to be clear. A Markov process is called a reversible Markov process or reversible Markov chain if there exists a positive stationary...
40 KB (6,462 words) - 01:59, 9 June 2025
statistics, diffusion processes are a class of continuous-time Markov process with almost surely continuous sample paths. Diffusion process is stochastic in...
5 KB (1,102 words) - 22:43, 13 April 2025
Fluid queue (redirect from Markov-modulated fluid queue)
values. The model is a particular type of piecewise deterministic Markov process and can also be viewed as a Markov reward model with boundary conditions...
23 KB (2,602 words) - 13:49, 23 May 2025
mixing time Markov partition Markov process Continuous-time Markov process Piecewise-deterministic Markov process Martingale Doob martingale Optional...
11 KB (1,000 words) - 14:07, 2 May 2024
Itô calculus (redirect from Itô process)
such as piecewise constant, left continuous and adapted processes where the integral can be written explicitly. Such simple predictable processes are linear...
31 KB (4,554 words) - 03:50, 6 May 2025
process (in the context of probability), an example of a (stochastic) hybrid system with zero flow component Piecewise-deterministic Markov process (PDMP)...
13 KB (1,559 words) - 22:59, 24 June 2025
polynomial-time and robust envy-free. For deterministic mechanisms, the results are mostly negative, even when all agents have piecewise-constant valuations. Kurokawa...
27 KB (3,353 words) - 15:17, 25 May 2025
interpolation, however, yield a piecewise continuous function composed of many polynomials to model the data set. Extrapolation is the process of estimating, beyond...
43 KB (5,025 words) - 15:47, 14 March 2025
Gaussian random field (category Spatial processes)
functions of the variables. A one-dimensional GRF is also called a Gaussian process. An important special case of a GRF is the Gaussian free field. With regard...
2 KB (262 words) - 15:31, 16 March 2025
Speech recognition (section Hidden Markov models)
lower levels, and making more deterministic decisions only at the highest level, speech recognition by a machine is a process broken into several phases...
123 KB (13,147 words) - 07:04, 30 June 2025
statistics, a continuous-time stochastic process, or a continuous-space-time stochastic process is a stochastic process for which the index variable takes a...
2 KB (212 words) - 13:14, 20 June 2022
{\displaystyle \max(F_{T}-K,\;0)} under the probability distribution of the process F t {\displaystyle F_{t}} . Except for the special cases of β = 0 {\displaystyle...
18 KB (2,483 words) - 22:26, 10 September 2024
Multi-armed bandit (redirect from Bandit process)
2012-10-12. Ortner, R. (2010). "Online regret bounds for Markov decision processes with deterministic transitions". Theoretical Computer Science. 411 (29):...
67 KB (7,665 words) - 17:30, 26 June 2025
ones. The value function v ( x , y ) {\displaystyle v(x,y)} is defined piecewise depending on whether y {\displaystyle y} is desirable ( λ D {\displaystyle...
62 KB (8,617 words) - 19:50, 11 May 2025
Dynamic Time Warping (DTW) to Hidden Markov Model (HMM)" (PDF). Juang, B. H. (September 1984). "On the hidden Markov model and dynamic time warping for...
32 KB (3,863 words) - 10:42, 24 June 2025
DEVS (redirect from Finite & Deterministic Discrete Event System Specification)
graphical representation of state and transition relations Markov chain: a stochastic process in which the future will be determined by the current state...
75 KB (13,718 words) - 07:59, 10 May 2025
in different clusters (between-cluster sum of squares, BCSS). This deterministic relationship is also related to the law of total variance in probability...
62 KB (7,754 words) - 11:44, 13 March 2025
Rough path (category Stochastic processes)
equations driven by non-semimartingale paths, such as Gaussian processes and Markov processes. Rough paths are paths taking values in the truncated free tensor...
29 KB (5,685 words) - 18:42, 14 June 2025
constraints Approaches to deal with uncertainty: Markov decision process Partially observable Markov decision process Robust optimization Wald's maximin model...
70 KB (8,327 words) - 09:12, 7 June 2025
Central limit theorem (section Dependent processes)
and the distributional form of the stochastic fluctuations around the deterministic number μ {\displaystyle \mu } during this convergence. More precisely...
67 KB (9,202 words) - 03:48, 9 June 2025
himself was influenced by Hédi Soula. Galves and Löcherbach referred to the process that Cessac described as "a version in a finite dimension" of their own...
17 KB (3,029 words) - 15:29, 1 July 2025