CEConstraint (d4servletshared 4.6.7 API)

java.lang.Object
- dap4.ce.CEConstraint

All Implemented Interfaces:

dap4.core.data.Constraint

Direct Known Subclasses:

Universal
```
public class CEConstraint
extends java.lang.Object
implements dap4.core.data.Constraint
```
A Constraint is a structure containing a parsed representation of a constraint expression. Its purpose is define a subset of interest of a dataset.
The constraint object is defined with respect to some underlying DMR. It defines a subset view over that DMR in that it specifies a set of declarations (variables, enums, dimensions, groups) to be included. For each such variable, the constraint specifies any overriding of the dimensions of the variables. Additionally, each variable (if appropriate) may have a filter expr.
Thus, there are three 'sub' constraints within a full constraint. 1. Referencing - is a variable from the underlying dataset included in the constraint, directly (by or indirectly: e.g. fields of a structure when only the structure is referenced 2. Projection - the actual values of a variable to be included in the constraint; this is specified by a triple [start:stride:stop] for each dimension of a variable. 3. Selection (aka filters) - A predicate over the scalar fields of a row of a Sequence; if it evaluates to true, then that row matches the constraint.
There are multiple ways to effect a constraint. 1. Generate and test mode: the constraint is asked if a given element matches the constraint. E.g. a. For referencing, one might ask the constraint if a given variable or field is in the constraint b. For a projection filter, one might ask the constraint if a given set of dimension indices match the projection. c. For a selection filter, one might ask the constraint if a given sequence row matches the filter predicate 2. Iteration mode: the constraint provides an iterator that returns the elements matching the constraint. E.g. a. For referencing, the iterator would return all the variables and fields referenced in the constraint. b. For a projection filter, the iterator would return the successive sets of indices of the projection, or it could return the actual matching value. c. For a selection filter, the iterator would return either the row indices or the actual rows of a sequence that matched the filter predicate
3. Read mode: Sometimes, it may be more efficient to let the DataVariable object handle the constraint more directly. E.g. a. For example, if the data variable was backed by a netcdf file, then passing in the complete projection might be more efficient than pulling values 1 by 1. b. Similarly, if the sequence object had an associated btree, then it would be more efficient to allow the sequence object to evaluate the filter using the btree. Note that this requires analysis of the filter expression to see if the btree is usable.
Ideally, we would allow all three modes, but for now, only generate-and-test and iteration are implemented, and only a subset of those. Specifically, iteration is provided for referencing, projection, and selection (filters). Generate-and-test is provided for referencing and selection. It is not provided for projection (for now) because it essentially requires the inverse of iteration and that is fairly tricky.

Nested Class Summary

Nested Classes
Modifier and Type	Class and Description
`protected static class`	`CEConstraint.Expand`
`protected static class`	`CEConstraint.FilterIterator`
`protected static class`	`CEConstraint.ReferenceIterator`
`protected static class`	`CEConstraint.Segment`

Field Summary

Fields
Modifier and Type	Field and Description
`protected java.util.Map<dap4.core.dmr.DapNode,java.util.List<dap4.core.dmr.DapAttribute>>`	`attributes`
`protected java.util.List<dap4.core.dmr.DapDimension>`	`dimrefs`
`protected dap4.core.dmr.DapDataset`	`dmr`
`protected java.util.List<dap4.core.dmr.DapEnum>`	`enums`
`protected CEConstraint.Expand`	`expansion`
`protected boolean`	`finished`
`protected java.util.List<dap4.core.dmr.DapGroup>`	`groups`
`protected java.util.Map<dap4.core.dmr.DapDimension,dap4.core.dmr.DapDimension>`	`redef`
`protected java.util.Map<dap4.core.dmr.DapDimension,dap4.core.util.Slice>`	`redefslice`
`protected java.util.List<dap4.core.dmr.DapDimension>`	`refdims`
`protected java.util.List<CEConstraint.Segment>`	`segments` "Map" of variables (at all levels) to be included Maps variables -> associated slices and is modified by computdimensions().
`protected static java.util.Map<dap4.core.dmr.DapDataset,CEConstraint>`	`universals`
`protected java.util.List<dap4.core.dmr.DapVariable>`	`variables` Also keep a raw list of variables

Constructor Summary

Constructors
Constructor and Description

CEConstraint()

CEConstraint(dap4.core.dmr.DapDataset dmr)

Constructors
Constructor and Description
`CEConstraint()`
`CEConstraint(dap4.core.dmr.DapDataset dmr)`

Method Summary

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`void`	`addAttribute(dap4.core.dmr.DapNode node, dap4.core.dmr.DapAttribute attr)`
`void`	`addRedef(dap4.core.dmr.DapDimension dim, dap4.core.util.Slice slice)`
`void`	`addVariable(dap4.core.dmr.DapVariable var, java.util.List<dap4.core.util.Slice> slices)`
`protected static int`	`compare(java.lang.Object lvalue, java.lang.Object rvalue)`
`protected void`	`computedimensions()` Compute dimension related information using slicing and redef info.
`protected void`	`computeenums()` Walk all the included variables and accumulate the referenced enums
`protected void`	`computegroups()` Walk all the included declarations and accumulate the set of referenced groups
`void`	`contract()` Locate each Structure\|Sequence and: 1.
`protected boolean`	`contractR(dap4.core.dmr.DapStructure dstruct, java.util.Set<dap4.core.dmr.DapStructure> contracted)` Recursive helper
`protected void`	`dumpvar(CEConstraint.Segment seg, java.lang.StringBuilder buf, boolean forconstraint)` Recursive helper for tostring/toConstraintString
`protected java.lang.Object`	`eval(dap4.core.dmr.DapSequence seq, dap4.core.data.DataRecord record, CEAST expr)` Evaluate a filter with respect to a Sequence record.
`void`	`expand()` Locate each unexpanded Structure\|Sequence and: 1.
`protected int`	`expansionCount(dap4.core.dmr.DapStructure struct)` Count the number of fields of a structure that already in this view.
`protected static java.lang.Object`	`fieldValue(dap4.core.dmr.DapSequence seq, dap4.core.data.DataRecord record, java.lang.String field)`
`CEConstraint.FilterIterator`	`filterIterator(dap4.core.dmr.DapSequence dapseq, dap4.core.data.DataSequence dataseq)` Selection X Iterator Filter evaluation using an iterator.
`protected CEConstraint.Segment`	`findSegment(dap4.core.dmr.DapVariable var)`
`protected int`	`findVariableIndex(dap4.core.dmr.DapVariable var)`
`CEConstraint`	`finish()` Finish creating this Constraint.
`java.util.List<dap4.core.dmr.DapDimension>`	`getConstrainedDimensions(dap4.core.dmr.DapVariable var)`
`java.util.List<dap4.core.util.Slice>`	`getConstrainedSlices(dap4.core.dmr.DapVariable var)`
`dap4.core.dmr.DapDataset`	`getDMR()`
`dap4.core.dmr.DapDimension`	`getRedefDim(dap4.core.dmr.DapDimension orig)`
`static CEConstraint`	`getUniversal(dap4.core.dmr.DapDataset dmr)`
`protected boolean`	`isWholeCompound(dap4.core.dmr.DapStructure dstruct)` See if a structure is "whole", which means that none of its fields is missing from the constraint, all of fields use default (non-constrained) dimension), and all of its fields are also whole.
`boolean`	`match(dap4.core.dmr.DapSequence seq, dap4.core.data.DataRecord rec)` Selection X match Evaluate a filter with respect to a Sequence record.
`protected boolean`	`matches(dap4.core.dmr.DapSequence seq, dap4.core.data.DataRecord rec, CEAST filter)` Evaluate a filter with respect to a Sequence record.
`dap4.core.util.Odometer`	`projectionIterator(dap4.core.dmr.DapVariable var)` Projection X Iterator This basically returns an odometer that will iterate over the appropriate values.
`CEConstraint.ReferenceIterator`	`referenceIterator()` Reference X Iterator Iterate over the variables and return those that are referenced.
`boolean`	`references(dap4.core.dmr.DapNode node)` Reference X match
`static void`	`release(dap4.core.dmr.DapDataset dmr)`
`void`	`setFilter(dap4.core.dmr.DapVariable var, CEAST filter)`
`java.lang.String`	`toConstraintString()` Convert the view to a constraint string suitable for use in a URL, except not URL encoded.
`java.lang.String`	`toString()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

- Field Detail
  - universals
```
protected static java.util.Map<dap4.core.dmr.DapDataset,CEConstraint> universals
```
  - dmr
```
protected dap4.core.dmr.DapDataset dmr
```
  - segments
```
protected java.util.List<CEConstraint.Segment> segments
```
    "Map" of variables (at all levels) to be included Maps variables -> associated slices and is modified by computdimensions(). Note that we keep the original insertion order
  - variables
```
protected java.util.List<dap4.core.dmr.DapVariable> variables
```
    Also keep a raw list of variables
  - redefslice
```
protected java.util.Map<dap4.core.dmr.DapDimension,dap4.core.util.Slice> redefslice
```
  - attributes
```
protected java.util.Map<dap4.core.dmr.DapNode,java.util.List<dap4.core.dmr.DapAttribute>> attributes
```
  - redef
```
protected java.util.Map<dap4.core.dmr.DapDimension,dap4.core.dmr.DapDimension> redef
```
  - dimrefs
```
protected java.util.List<dap4.core.dmr.DapDimension> dimrefs
```
  - enums
```
protected java.util.List<dap4.core.dmr.DapEnum> enums
```
  - groups
```
protected java.util.List<dap4.core.dmr.DapGroup> groups
```
  - refdims
```
protected java.util.List<dap4.core.dmr.DapDimension> refdims
```
  - finished
```
protected boolean finished
```
  - expansion
```
protected CEConstraint.Expand expansion
```
- Constructor Detail
  - CEConstraint
```
public CEConstraint()
```
  - CEConstraint
```
public CEConstraint(dap4.core.dmr.DapDataset dmr)
```
- Method Detail
  - getUniversal
```
public static CEConstraint getUniversal(dap4.core.dmr.DapDataset dmr)
```
  - release
```
public static void release(dap4.core.dmr.DapDataset dmr)
```
  - fieldValue
```
protected static java.lang.Object fieldValue(dap4.core.dmr.DapSequence seq,
                                             dap4.core.data.DataRecord record,
                                             java.lang.String field)
                                      throws dap4.core.util.DapException
```
    Throws:
    
    dap4.core.util.DapException
  - compare
```
protected static int compare(java.lang.Object lvalue,
                             java.lang.Object rvalue)
                      throws dap4.core.util.DapException
```
    Throws:
    
    dap4.core.util.DapException
  - eval
```
protected java.lang.Object eval(dap4.core.dmr.DapSequence seq,
                                dap4.core.data.DataRecord record,
                                CEAST expr)
                         throws dap4.core.util.DapException
```
    Evaluate a filter with respect to a Sequence record. Assumes the filter has been canonicalized so that the lhs is a variable.
    
    Parameters:
    
    seq - the template
    
    record - the record to evaluate
    
    expr - the filter
    
    Throws:
    
    dap4.core.util.DapException
  - getDMR
```
public dap4.core.dmr.DapDataset getDMR()
```
  - getRedefDim
```
public dap4.core.dmr.DapDimension getRedefDim(dap4.core.dmr.DapDimension orig)
```
  - addRedef
```
public void addRedef(dap4.core.dmr.DapDimension dim,
                     dap4.core.util.Slice slice)
```
  - addVariable
```
public void addVariable(dap4.core.dmr.DapVariable var,
                        java.util.List<dap4.core.util.Slice> slices)
                 throws dap4.core.util.DapException
```
    Throws:
    
    dap4.core.util.DapException
  - addAttribute
```
public void addAttribute(dap4.core.dmr.DapNode node,
                         dap4.core.dmr.DapAttribute attr)
```
  - setFilter
```
public void setFilter(dap4.core.dmr.DapVariable var,
                      CEAST filter)
```
  - getConstrainedSlices
```
public java.util.List<dap4.core.util.Slice> getConstrainedSlices(dap4.core.dmr.DapVariable var)
```
  - getConstrainedDimensions
```
public java.util.List<dap4.core.dmr.DapDimension> getConstrainedDimensions(dap4.core.dmr.DapVariable var)
```
  - toString
```
public java.lang.String toString()
```
    Overrides:
    
    toString in class java.lang.Object
  - finish
```
public CEConstraint finish()
                    throws dap4.core.util.DapException
```
    Finish creating this Constraint.
    
    Throws:
    
    dap4.core.util.DapException
  - toConstraintString
```
public java.lang.String toConstraintString()
```
    Convert the view to a constraint string suitable for use in a URL, except not URL encoded.
    
    Returns:
    
    constraint string
  - dumpvar
```
protected void dumpvar(CEConstraint.Segment seg,
                       java.lang.StringBuilder buf,
                       boolean forconstraint)
```
    Recursive helper for tostring/toConstraintString
    
    Parameters:
    
    seg -
    
    buf -
    
    forconstraint -
  - references
```
public boolean references(dap4.core.dmr.DapNode node)
```
    Reference X match
    
    Parameters:
    
    node - to test
    
    Returns:
    
    true if node is referenced by this constraint
  - referenceIterator
```
public CEConstraint.ReferenceIterator referenceIterator()
                                                 throws dap4.core.util.DapException
```
    Reference X Iterator Iterate over the variables and return those that are referenced. The order of return is preorder. Inputs: 1. the variable whose slices are to be iterated.
    
    Returns:
    
    ReferenceIterator
    
    Throws:
    
    dap4.core.util.DapException - if could not create.
  - projectionIterator
```
public dap4.core.util.Odometer projectionIterator(dap4.core.dmr.DapVariable var)
                                           throws dap4.core.util.DapException
```
    Projection X Iterator This basically returns an odometer that will iterate over the appropriate values.
    
    Parameters:
    
    var - over whose dimensions to iterate
    
    Throws:
    
    dap4.core.util.DapException
  - match
```
public boolean match(dap4.core.dmr.DapSequence seq,
                     dap4.core.data.DataRecord rec)
              throws dap4.core.util.DapException
```
    Selection X match
    Evaluate a filter with respect to a Sequence record. Assumes the filter has been canonicalized.
    
    Parameters:
    
    seq - the template
    
    rec - the record to evaluate
    
    Throws:
    
    dap4.core.util.DapException
  - matches
```
protected boolean matches(dap4.core.dmr.DapSequence seq,
                          dap4.core.data.DataRecord rec,
                          CEAST filter)
                   throws dap4.core.util.DapException
```
    Evaluate a filter with respect to a Sequence record.
    
    Parameters:
    
    seq - the template
    
    rec - the record to evaluate
    
    filter - the filter
    
    Throws:
    
    dap4.core.util.DapException
  - filterIterator
```
public CEConstraint.FilterIterator filterIterator(dap4.core.dmr.DapSequence dapseq,
                                                  dap4.core.data.DataSequence dataseq)
                                           throws dap4.core.util.DapException
```
    Selection X Iterator Filter evaluation using an iterator. The iterator evaluates records from a sequence one-by-one and returns the next one that matches the filter. In order to evaluate a record, we need as input: 1. the DapSequence from which the free variables in the filter are taken. 2. the DataRecord to evaluate
    
    Parameters:
    
    dapseq -
    
    dataseq -
    
    Throws:
    
    dap4.core.util.DapException
  - findVariableIndex
```
protected int findVariableIndex(dap4.core.dmr.DapVariable var)
```
  - findSegment
```
protected CEConstraint.Segment findSegment(dap4.core.dmr.DapVariable var)
```
  - expand
```
public void expand()
```
    Locate each unexpanded Structure|Sequence and: 1. check that none of its fields is referenced => do not expand 2. add all of its fields as leaves Note that #2 may end up adding additional leaf structs &/or seqs
  - contract
```
public void contract()
```
    Locate each Structure|Sequence and: 1. check that all of its fields are referenced recursively and not constrained, otherwise ignore 2. contract by removing all of the fields of the Structure or Sequence. This is intended to be (not quite) the dual of expand();
  - contractR
```
protected boolean contractR(dap4.core.dmr.DapStructure dstruct,
                            java.util.Set<dap4.core.dmr.DapStructure> contracted)
```
    Recursive helper
    
    Parameters:
    
    dstruct - to contract
    
    contracted - set of already contracted compounds
    
    Returns:
    
    true if this structure was contracted, false otherwise
  - expansionCount
```
protected int expansionCount(dap4.core.dmr.DapStructure struct)
```
    Count the number of fields of a structure that already in this view.
    
    Parameters:
    
    struct - the dapstructure to check
    
    Returns:
    
    # of fields in this view
    
    Throws:
    
    dap4.core.util.DapException
  - isWholeCompound
```
protected boolean isWholeCompound(dap4.core.dmr.DapStructure dstruct)
```
    See if a structure is "whole", which means that none of its fields is missing from the constraint, all of fields use default (non-constrained) dimension), and all of its fields are also whole. This must be done recursively.
    
    Parameters:
    
    dstruct - to test
    
    Returns:
    
    true if this structure is whole.
  - computedimensions
```
protected void computedimensions()
                          throws dap4.core.util.DapException
```
    Compute dimension related information using slicing and redef info. In effect, this is where projection constraints are applied
    Assume that the constraint compiler has given us the following info:
    1. A list of the variables to include.
    2. A pair (DapDimension,Slice) for each redef
    3. For each variable in #1, a list of slices taken from the constraint expression
    Two products will be produced.
    1. The variables map will be modified so that the slices properly reflect any original or redef dimensions.
    2. A set, dimrefs, of all referenced original dimensions.
    The processing is as follows
    1. For each redef create a new redef dimension
    2. For each variable:
      
      if the variable is scalar, do nothing.
      if the variable has no associated slices, then make its new dimensions be the original dimensions.
      otherwise, walk the slices and create new dimensions from them; use redefs where indicated
    Throws:
    
    dap4.core.util.DapException
  - computeenums
```
protected void computeenums()
```
    Walk all the included variables and accumulate the referenced enums
  - computegroups
```
protected void computegroups()
```
    Walk all the included declarations and accumulate the set of referenced groups

Class CEConstraint

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

universals

dmr

segments

variables

redefslice

attributes

redef

dimrefs

enums

groups

refdims

finished

expansion

Constructor Detail

CEConstraint

CEConstraint

Method Detail

getUniversal

release

fieldValue

compare

eval

getDMR

getRedefDim

addRedef

addVariable

addAttribute

setFilter

getConstrainedSlices

getConstrainedDimensions

toString

finish

toConstraintString

dumpvar

references

referenceIterator

projectionIterator

match

matches

filterIterator

findVariableIndex

findSegment

expand

contract

contractR

expansionCount

isWholeCompound

computedimensions

computeenums

computegroups