Automaton

A (nondeterministic two-way) nested stack automaton is a tuple ⟨Q,Σ,Γ,δ,q₀,Z₀,F,[,],]⟩ where

• Q, Σ, and Γ is a nonempty finite set of states, input symbols, and stack symbols, respectively,
• [, ], and ] are distinct special symbols not contained in Σ ∪ Γ,
  • [ is used as left endmarker for both the input string and a (sub)stack string,
  • ] is used as right endmarker for these strings,
  • ] is used as the final endmarker of the string denoting the whole stack.^{[note 1]}
• An extended input alphabet is defined by Σ' = Σ ∪ {[,]}, an extended stack alphabet by Γ' = Γ ∪ {]}, and the set of input move directions by D = {-1,0,+1}.
• δ, the finite control, is a mapping from Q × Σ' × (Γ' ∪ [Γ' ∪ {], []}) into finite subsets of Q × D × ([Γ^* ∪ D), such that δ maps^{[note 2]}

Informally, the top symbol of a (sub)stack together with its preceding left endmarker "[" is viewed as a single symbol;^[4] then δ reads

• the current state,
• the current input symbol, and
• the current stack symbol,

and outputs

• the next state,
• the direction in which to move on the input, and
• the direction in which to move on the stack, or the string of symbols to replace the topmost stack symbol.

• q₀ ∈ Q is the initial state,
• Z₀ ∈ Γ is the initial stack symbol,
• F ⊆ Q is the set of final states.

Configuration

A configuration, or instantaneous description of such an automaton consists in a triple ⟨ q, [a₁a₂...a_i...a_n-1], [Z₁X₂...X_j...X_m-1] ⟩, where

• q ∈ Q is the current state,
• [a₁a₂...a_i...a_n-1] is the input string; for convenience, a₀ = [ and a_n = ] is defined^{[note 3]} The current position in the input, viz. i with 0 ≤ i ≤ n, is marked by underlining the respective symbol.
• [Z₁X₂...X_j...X_m-1] is the stack, including substacks; for convenience, X₁ = [Z₁ ^{[note 4]} and X_m = ] is defined. The current position in the stack, viz. j with 1 ≤ j ≤ m, is marked by underlining the respective symbol.

Example

An example run (input string not shown):