Example of livewire segmentation on a baby's photo

Livewire, is a segmentation technique which allows a user to select regions of interest to be extracted quickly and accurately, using simple mouse clicks.^[1] It is based on the lowest cost path algorithm, by Edsger W. Dijkstra. Firstly convolve the image with a Sobel filter to extract edges. Each pixel of the resulting image is a vertex of the graph and has edges going to the 4 pixels around it, as up, down, left, right. The edge costs are defined based on a cost function. In 1995, Eric N. Mortensen and William A. Barrett made some extension work on livewire segmentation tool, which is known as Intelligent Scissors.^[2]

Livewire segmentation

The user sets the starting point clicking on an image's pixel, known as an anchor. Then, as he starts to move the mouse over other points, the smallest cost path is drawn from the anchor to the pixel where the mouse is over, changing itself if the user moves the mouse. If he wants to choose the path that is being displayed, he simply clicks the image again.

One can easily see in the right image, that the places where the user clicked to outline the desired region of interest are marked with a small square. It is also easy to see that the livewire has snapped on the image's borders.

Livewire algorithm

Convolve the image with a Sobel filter to extract edges. Using this filtered image create a graph using pixels as nodes with edges in four directions (up, down, left right).^[1] Edges are weighted with features gathered from the Sobel filter making it less costly to stay on an edge. Several different cost methods are possible but the most important is the gradient magnitude^[1]

Live-Wire 2-D DP graph search algorithm in pseudocode ^[2]

algorithm Livewire is
    input:
        s                       {Start (or seed) pixel.}
        l(q, r)                 {Local cost function for link between pixels q and r.} 
    data structures:
        L                       {List of active pixels sorted by total cost (initially empty).}
        N(q)                    {Neighborhood set of q (contains 8 neighbors of pixel).} 
        e(q)                    {Boolean function indicating if q has been expanded/processed.}
        g(q)                    {Total cost function from seed point to q.}
    output:
        p                       {Pointers from each pixel indicating the minimum cost path.}

    g(s) ← 0; L ← s;        {Initialize active list with zero cost seed pixel.}
    while L≠∅ do begin      {While still points to expand.}
        q ← min(L);             {Remove minimum cost pixel q from active list.}
        e(q) ← TRUE;             {Mark q as expanded (i.e., processed).}
        for each r∈N(q) such that not e(r) do begin
            gtmp ←g(q) + l(q, r);        {Compute total cost to neighbor.}
            if r∈L and gtmp < g(r) then  {Remove higher cost neighbor's from list.}
                r ← L;                      
            if r∉L then begin            {If neighbor not on list, }
                g(r) ← gtmp;             {assign neighbor's total cost, }
                p(r) ← q;                {set (or reset) back pointer, } 
                L ← r;                   {and place on (or return to)  active list.} 
            end                                
        end
    end

Extension to 3D

In 2010, Leo Grady extended the Livewire algorithm to 3D.^[3] This extension treated the 2D Livewire algorithm as enabling a user to specify a 0-dimensional boundary (two points) and finding the minimal 1-dimensional coboundary (curve) connecting those points, where the minimum is defined in terms of image properties. In order to extend the algorithm to 3D, the user is instead asked to specify one or more 1-dimensional boundaries (closed curves) and the algorithm finds the minimal 2-dimensional coboundary (surface) bounded by the 1-dimensional curves, where the minimum surface is defined in terms of image properties. This 3D extension of Livewire leans heavily on concepts of discrete exterior calculus to reinterpret the 2D Livewire algorithm from the standpoint of boundary/coboundary operators and then apply these concepts in 3D. An efficient algorithm for computing the 3D minimal surface is also provided in the Grady paper.

See also

• Segmentation

References

External links

• Open Source Java implementation of Livewire Image Segmentation Tool for ImageJ - Daniel Lelis Baggio
• Coronary Segmentation video
• Open source Python implementation