ucar.nc2.grib.collection

Class PartitionCollection

java.lang.Object

ucar.nc2.grib.collection.GribCollection

ucar.nc2.grib.collection.PartitionCollection

All Implemented Interfaces:

AutoCloseable, FileCacheable

Direct Known Subclasses:

Grib1Partition, Grib2Partition

public abstract class PartitionCollection
extends GribCollection

Collection of GribCollections or other PartionCollections, partitioned by reference time.

Since:

12/7/13

Author:

John

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	PartitionCollection.Partition
class	PartitionCollection.VariableIndexPartitioned

Nested classes/interfaces inherited from class ucar.nc2.grib.collection.GribCollection

GribCollection.Dataset, GribCollection.GroupGC, GribCollection.HorizCoordSys, GribCollection.NetcdfFileGC, GribCollection.Record, GribCollection.Type, GribCollection.VariableIndex

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	isPartitionOfPartitions
protected org.slf4j.Logger	logger
protected List<PartitionCollection.Partition>	partitions

Fields inherited from class ucar.nc2.grib.collection.GribCollection

backProcessId, center, config, cust, datasets, directory, fileMap, genProcessId, genProcessType, horizCS, indexFilename, indexRaf, isGrib1, local, master, masterRuntime, MISSING_RECORD, name, objCache, params, subcenter, version

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	PartitionCollection(String name, File directory, FeatureCollectionConfig config, boolean isGrib1, org.slf4j.Logger logger)

Method Summary

Methods

Modifier and Type	Method and Description
void	addPartition(MCollection dcm)
PartitionCollection.Partition	addPartition(String name, String filename, long lastModified, String directory)
static void	disableNetcdfFileCache()
List<String>	getFilenames() Use partition names as the file names
GribCollection	getLatestGribCollection(List<String> paths)
PartitionCollection.Partition	getPartition(int idx)
PartitionCollection.Partition	getPartitionByName(String name)
static FileCache	getPartitionCache()
Iterable<PartitionCollection.Partition>	getPartitions()
int	getPartitionSize()
List<PartitionCollection.Partition>	getPartitionsSorted()
RandomAccessFile	getRaf(int partno, int fileno)
GribCollection.VariableIndex	getVariable2DByHash(GribCollection.HorizCoordSys hcs, int cdmHash)
static void	initPartitionCache(int minElementsInMemory, int maxElementsInMemory, int period)
boolean	isPartitionOfPartitions()
PartitionCollection.VariableIndexPartitioned	makeVariableIndexPartitioned(GribCollection.GroupGC group, GribCollection.VariableIndex from, int nparts) Create a VariableIndexPartitioned
void	removePartition(PartitionCollection.Partition p)
void	showIndex(Formatter f)
void	sortPartitions()

Methods inherited from class ucar.nc2.grib.collection.GribCollection

addHorizCoordSystem, close, copyInfo, disableDataRafCache, findDataset, findHorizCS, findMFileByName, getBackProcessId, getCenter, getConfig, getDataRaf, getDataRafCache, getDatasetCanonical, getDatasets, getDirectory, getDiskCache2, getExistingFileOrCache, getFileInCache, getFileInCache, getFilename, getFiles, getGenProcessId, getGenProcessType, getGridDataset, getHorizCS, getIndexFilepathInCache, getLastModified, getLocal, getLocation, getMaster, getMasterRuntime, getName, getNetcdfDataset, getParams, getSubcenter, initDataRafCache, isGrib1, makeDataset, makeGroup, makeHorizCS, makeName, makeNameFromIndexFilename, makeTopIndexFileFromConfig, makeVariableIndex, makeVariableIndex, makeVariableName, setDirectory, setDiskCache2, setFileCache, setFileMap, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

logger

protected final org.slf4j.Logger logger

partitions

protected List<PartitionCollection.Partition> partitions

isPartitionOfPartitions

protected boolean isPartitionOfPartitions

Constructor Detail

PartitionCollection

protected PartitionCollection(String name,
                   File directory,
                   FeatureCollectionConfig config,
                   boolean isGrib1,
                   org.slf4j.Logger logger)

Method Detail

initPartitionCache

public static void initPartitionCache(int minElementsInMemory,
                      int maxElementsInMemory,
                      int period)

getPartitionCache

public static FileCache getPartitionCache()

disableNetcdfFileCache

public static void disableNetcdfFileCache()

isPartitionOfPartitions

public boolean isPartitionOfPartitions()

getVariable2DByHash

public GribCollection.VariableIndex getVariable2DByHash(GribCollection.HorizCoordSys hcs,
                                               int cdmHash)

getFilenames

public List<String> getFilenames()

Use partition names as the file names

Overrides:

getFilenames in class GribCollection

Returns:

list of filename.

addPartition

public PartitionCollection.Partition addPartition(String name,
                                         String filename,
                                         long lastModified,
                                         String directory)

addPartition

public void addPartition(MCollection dcm)

sortPartitions

public void sortPartitions()

makeVariableIndexPartitioned

public PartitionCollection.VariableIndexPartitioned makeVariableIndexPartitioned(GribCollection.GroupGC group,
                                                                        GribCollection.VariableIndex from,
                                                                        int nparts)

Create a VariableIndexPartitioned

Parameters:

group - new VariableIndexPartitioned is in this group

from - copy info from here

nparts - size of partition list

Returns:

a new VariableIndexPartitioned

getPartitions

public Iterable<PartitionCollection.Partition> getPartitions()

getPartition

public PartitionCollection.Partition getPartition(int idx)

getPartitionByName

public PartitionCollection.Partition getPartitionByName(String name)

getPartitionSize

public int getPartitionSize()

getPartitionsSorted

public List<PartitionCollection.Partition> getPartitionsSorted()

removePartition

public void removePartition(PartitionCollection.Partition p)

getLatestGribCollection

public GribCollection getLatestGribCollection(List<String> paths)
                                       throws IOException

Throws:

IOException

showIndex

public void showIndex(Formatter f)

Overrides:

showIndex in class GribCollection

getRaf

public RandomAccessFile getRaf(int partno,
                      int fileno)
                        throws IOException

Throws:

IOException