EVOLUTION-MANAGER

Edit File: drv_db2_raster.html

<!DOCTYPE HTML SYSTEM>
<html>
<head>
<title>DB2 raster</title>
</head>

The DB2 driver is based largely on the source code for the
OGR/DB2 GeoPackage (GPKG) driver, replaceing SQLITE functionality with
corresponding DB2 functionality. Appreciation is expressed for the
major development required to produce the GeoPackage driver which
dramatically reduced the effort to produce the DB2 driver.
At some point it may be worthwhile to explore whether refactoring of
the class structure to share common functionality is practical.

The DB2 driver largely implements the GeoPackage standard, with the main
difference that the "gpkg_" prefix is replaced with "gpkg." in the
DB2 table name, assigning them to a distinct database schema.


The documentation below is largely copied from the drv_geopackage_raster.html
documentation.
References to the GeoPackage standard have been left as such.
References to the implementation have been changed to DB2.
In some cases it isn't clear whether we should refer to
"DB2 tiles" or "GeoPackage tiles".

<h1>DB2 raster</h1>

Starting with GDAL 2.0, this driver implements full read/creation/update of
tables containing raster tiles in the
<a href="http://www.geopackage.org/spec/">OGC GeoPackage format standard</a>.
The GeoPackage standard uses a SQLite database file as a generic container, and the standard defines:

<ul>
 <li>Expected metadata tables (<code>gpkg.contents</code>,
 <code>gpkg.spatial_ref_sys</code>, <code>gpkg.tile_matrix</code>,
 <code>gpkg.tile_matrix_set</code>, ...)</li>
 <li>Tile format encoding (PNG and JPEG for base specification, WebP as extension) and tiling conventions</li>
 <li>Naming and conventions for extensions</li>
</ul>
This driver reads and writes DB2 tables in the DB2 database, so it must be
run by a user with create authority on the database it is working with.

The driver can also handle DB2 vectors. See
<a href="drv_db2.html">DB2 vector</a> documentation page

Various kind of input datasets can be converted to DB2 raster :
<ul>
<li>Single band grey level</li>
<li>Single band with R,G,B or R,G,B,A color table</li>
<li>Two bands: first band with grey level, second band with alpha channel</li>
<li>Three bands: Red, Green, Blue</li>
<li>Four band: Red, Green, Blue, Alpha</li>
</ul>
DB2 rasters only support Byte data type.

All raster extensions standardized by the GeoPackage specification are supported in read and creation :

<ul>
<li>gpkg.webp: when storing WebP tiles, provided that GDAL is compiled against libwebp.</li>
<li>gpkg.zoom_other: when resolution of consecutive zoom levels does not vary with a factor of 2.</li>
</ul>

<h2>Opening options</h2>

By default, the driver will expose a DB2 dataset as a four band (Red,Green,
Blue,Alpha) dataset, which gives the maximum compatibility with the various encodings of
tiles that can be stored. It is possible to specify an explicit number of bands
with the BAND_COUNT opening option.

The driver will use the geographic/projected extent indicated in the
<a href="http://www.geopackage.org/spec/#_contents">gpkg.contents</a> table,
and do necessary clipping, if needed, to respect
that extent. However that information being optional, if omitted, the driver
will use the extent provided by the
<a href="http://www.geopackage.org/spec/#_tile_matrix_set">gpkg.tile_matrix_set</a>,
which covers the extent at all zoom levels. The user can also specify the USE_TILE_EXTENT=YES
open option to use the actual extent of tiles at the maximum zoom level. Or
it can specify any of MINX/MINY/MAXX/MAXY to have a custom extent.

The following open options are available:
<ul>
<li>TABLE=table_name: Name of the table containing the tiles (called
<a href="http://www.geopackage.org/spec/#tiles_user_tables">"Tile Pyramid User Data Table"</a>
in the GeoPackage specification language). If
the DB2 dataset only contains one table, this option is not necessary.
Otherwise, it is required.</li>
<li>ZOOM_LEVEL=value: Integer value between 0 and the maximum filled in
the gpkg.tile_matrix table. By default, the driver will select the maximum
zoom level, such as at least one tile at that zoom level is found in the raster table.</li>
<li>BAND_COUNT=1/2/3/4: Number of bands of the dataset exposed after opening.
Some conversions will be done when possible and implemented, but this might fail
in some cases, depending on the BAND_COUNT value and the number of bands of the tile.
Defaults to 4 (which is the always safe value).</li>
<li>MINX=value: Minimum longitude/easting of the area of interest.</li>
<li>MINY=value: Minimum latitude/northing of the area of interest.</li>
<li>MAXX=value: Maximum longitude/easting of the area of interest.</li>
<li>MAXY=value: Maximum latitude/northing of the area of interest.</li>
<li>USE_TILE_EXTENT=YES/NO: Whether to use the extent of actual existing
tiles at the zoom level of the full resolution dataset. Defaults to NO.</li>
<li>TILE_FORMAT=PNG_JPEG/PNG/PNG8/JPEG/WEBP: Format used to store tiles. See
<a href="#tile_format">Tile format</a> section. Only used in update mode. Defaults to PNG_JPEG.</li>
<li>QUALITY=1-100: Quality setting for JPEG and WEBP compression. Only used in update mode. Default to 75.</li>
<li>ZLEVEL=1-9: DEFLATE compression level for PNG tiles. Only used in update mode. Default to 6.</li>
<li>DITHER=YES/NO: Whether to use Floyd-Steinberg dithering (for TILE_FORMAT=PNG8).
Only used in update mode. Defaults to NO.</li>
</ul>

Note: open options are typically specified with "-oo name=value" syntax in
most GDAL utilities, or with the GDALOpenEx() API call.

<h2>Creation issues</h2>

Depending of the number of bands of the input dataset and the tile format
selected, the driver will do the necessary conversions to be compatible with the
tile format.

To add several tile tables to a DB2 dataset (seen as GDAL subdatasets),
or to add a tile table to an existing vector-only DB2, the generic
APPEND_SUBDATASET=YES creation option must be provided.

Fully transparent tiles will not be written to the database, as allowed by
the format.

The driver implements the Create() and IWriteBlock() methods, so that arbitrary
writing of raster blocks is possible, enabling the direct use of DB2 as
the output dataset of utilities such as gdalwarp.

On creation, raster blocks can be written only if the geotransformation
matrix has been set with SetGeoTransform() This is effectively needed to determine
the zoom level of the full resolution dataset based on the pixel resolution, dataset
and tile dimensions.

Technical/implementation note: when a dataset is opened with a non-default area of interest
(i.e. use of MINX,MINY,MAXX,MAXY or USE_TILE_EXTENT open option), or when creating/
opening a dataset with a non-custom tiling scheme, it is possible that GDAL blocks
do not exactly match a single DB2 tile. In which case, each GDAL
block will overlap four DB2 tiles. This is easily handled on the read side,
but on creation/update side, such configuration could cause numerous decompression/
recompression of tiles to be done, which might cause unnecessary quality loss when using
lossy compression (JPEG, WebP). To avoid that, the driver will create a temporary
database next to the main DB2 table to store partial DB2 tiles in a
lossless (and uncompressed) way. Once a tile has received data for its four quadrants
and for all the bands (or the dataset is closed or explicitly flushed with FlushCache()),
those uncompressed tiles are definitely transferred to the DB2 table with
the appropriate compression. All of this is transparent to the user of GDAL API/utilities

<h3><a id="tile_formats">Tile formats</a></h3>

DB2 can store tiles in different formats, PNG and/or JPEG for the baseline
specification, and WebP for extended DB2. Support for those tile formats
depend if the underlying drivers are available in GDAL, which is generally the
case for PNG and JPEG, but not necessarily for WebP since it requires GDAL to
be compiled against the optional libwebp.

By default, GDAL will use a mix of PNG and JPEG tiles. PNG tiles will be used
to store tiles that are not completely opaque, either because input dataset has
an alpha channel with non fully opaque content, or because tiles are partial due
to clipping at the right or bottom edges of the raster, or when a dataset is opened
with a non-default area of interest, or with a non-custom tiling scheme. On the
contrary, for fully opaque tiles, JPEG format will be used.

It is possible to select one unique tile format by setting the creation/open
option TILE_FORMAT to one of PNG, JPEG or WEBP. When using JPEG, the alpha channel
will not be stored. When using WebP, the
<a href="http://www.geopackage.org/spec/#extension_tiles_webp">gpkg.webp</a>
extension will be registered. The lossy compression of WebP is used.
Note that a recent enough libwebp
(&gt;=0.1.4) must be used to support alpha channel in WebP tiles.

PNG8 can be selected to use 8-bit PNG with a color table up to 256 colors.
On creation, an optimized color table is computed for each tile. The DITHER
option can be set to YES to use Floyd/Steinberg dithering algorithm, which
spreads the quantization error on neighbouring pixels for better rendering (note
however than when zooming in, this can cause non desirable visual artifacts).
Setting it to YES will generally cause less effective compression.
Note that at that time, such an 8-bit PNG formulation is only used for fully opaque tiles,
as the median-cut algorithm currently implemented to compute the optimal color
table does not support alpha channel (even if PNG8 format would potentially allow
color table with transparency). So when selecting PNG8, non fully opaque tiles
will be stored as 32-bit PNG.

<h3><a id="tiling_schemes">Tiling schemes</a></h3>

By default, conversion to DB2 will create a custom tiling scheme, such
that the input dataset can be losslessly converted, both at the pixel and
georeferencing level (if using a lossless tile format such as PNG). That
tiling scheme is such that its origin (min_x, max_y) in the
<a href="http://www.geopackage.org/spec/#_tile_matrix_set">gpkg.tile_matrix_set</a>
table perfectly matches the top left corner of the dataset, and the selected
resolution (pixel_x_size, pixel_y_size) at the computed maximum zoom_level of the
<a href="http://www.geopackage.org/spec/#_tile_matrix">gpkg.tile_matrix</a> table will
match the pixel width and height of the raster.

However to ease interoperability with other implementations, and enable use
of DB2 with tile servicing software, it is possible to select a predefined
tiling scheme that has world coverage. The available tiling schemes are :
<ul>
<li>GoogleCRS84Quad, as described in
<a href="http://portal.opengeospatial.org/files/?artifact_id=35326">OGC 07-057r7
WMTS 1.0</a> specification, Annex E.3. That tiling schemes consists of a single
256x256 tile at its zoom level 0, in EPSG:4326 CRS, with extent in longitude and
latitude in the range [-180,180]. Consequently, at zoom level 0, 64 lines are
unused at the top and bottom of that tile. This may cause issues with some
implementations of the specification, and there are some ambiguities about the
exact definition of this tiling scheme. Using InspireCRS84Quad/PseudoTMS_GlobalGeodetic
instead is therefore recommended.</li>
<li>GoogleMapsCompatible, as described in WMTS 1.0 specification, Annex E.4.
That tiling schemes consists of a single 256x256 tile at its zoom level 0,
in EPSG:3857 CRS, with extent in easting and northing in the range
[-20037508.34,20037508.34].</li>
<li>InspireCRS84Quad, as described in
<a href="http://inspire.ec.europa.eu/documents/Network_Services/TechnicalGuidance_ViewServices_v3.0.pdf">
Inspire View Services</a>.
That tiling schemes consists of two 256x256 tiles at its zoom level 0, in
EPSG:4326 CRS, with extent in longitude in the range [-180,180] and in latitude
in the range [-90,90].</li>
<li>PseudoTMS_GlobalGeodetic, based on the
<a href="http://wiki.osgeo.org/wiki/Tile_Map_Service_Specification#global-geodetic">
global-geodetic</a> profile of OSGeo TMS (Tile Map Service) specification.
This has exactly the same definition as InspireCRS84Quad tiling scheme. Note
however that full interoperability with TMS is not
possible due to the origin of numbering of tiles being the top left corner in
DB2 (consistently with WMTS convention), whereas TMS uses the bottom left
corner as origin.</li>
<li>PseudoTMS_GlobalMercator, based on the
<a href="http://wiki.osgeo.org/wiki/Tile_Map_Service_Specification#global-mercator">
global-mercator</a> profile of OSGeo TMS (Tile Map Service) specification.
That tiling schemes consists of four 256x256 tiles at its zoom level 0,
in EPSG:3857 CRS, with extent extent in easting and northing in the range
[-20037508.34,20037508.34]. The same remark as with PseudoTMS_GlobalGeodetic applies
regarding interoperability with TMS.</li>
</ul>

In all the above tiling schemes, consecutive zoom levels defer by a resolution
of a factor of two.

<h3>Creation options</h3>

The following creation options are available:

<ul>
<li>RASTER_TABLE=string. Name of tile user table. By default, based on
the source filename.</li>
<li>APPEND_SUBDATASET=YES/NO: If set to YES, an existing DB2 table
will not be priorly destroyed, such as to be able to add new content to it. Defaults to NO.</li>
<li>RASTER_IDENTIFIER=string. Human-readable identifier (e.g. short name), put
in the identifier column of the gpkg.contents table.</li>
<li>RASTER_DESCRIPTION=string. Human-readable description, put
in the description column of the gpkg.contents table.</li>
<li>BLOCKSIZE=integer. Block size in width and height in pixels.
Defaults to 256. Maximum supported is 4096. Should not be set when using a non-custom TILING_SCHEME.</li>
<li>BLOCKXSIZE=integer. Block width in pixels.
Defaults to 256. Maximum supported is 4096.</li>
<li>BLOCKYSIZE=integer. Block height in pixels.
Defaults to 256. Maximum supported is 4096.</li>
<li>TILE_FORMAT=PNG_JPEG/PNG/PNG8/JPEG/WEBP: Format used to store tiles. See
<a href="#tile_formats">Tile formats</a> section. Defaults to PNG_JPEG.</li>
<li>QUALITY=1-100: Quality setting for JPEG and WEBP compression. Default to 75.</li>
<li>ZLEVEL=1-9: DEFLATE compression level for PNG tiles. Default to 6.</li>
<li>DITHER=YES/NO: Whether to use Floyd-Steinberg dithering (for TILE_FORMAT=PNG8).
Defaults to NO.</li>
<li>TILING_SCHEME=CUSTOM/GoogleCRS84Quad/GoogleMapsCompatible/InspireCRS84Quad/PseudoTMS_GlobalGeodetic/PseudoTMS_GlobalMercator.
See <a href="#tiling_schemes">Tiling schemes</a> section. Defaults to CUSTOM.</li>
<li>ZOOM_LEVEL_STRATEGY=AUTO/LOWER/UPPER. Strategy to determine zoom level.
Only used for TILING_SCHEME is different from CUSTOM. LOWER will select the
zoom level immediately below the theoretical computed non-integral zoom level,
leading to subsampling. On the contrary, UPPER will select the immediately above
zoom level, leading to oversampling. Defaults to AUTO which selects the closest
zoom level.</li>
<li>RESAMPLING=NEAREST/BILINEAR/CUBIC/CUBICSPLINE/LANCZOS/MODE/AVERAGE.
Resampling algorithm. Only used for TILING_SCHEME is different from CUSTOM. Defaults
to BILINEAR.</li>
</ul>

<h2>Overviews</h2>

gdaladdo / BuildOverviews() can be used to compute overviews. Power-of-two
overview factors (2,4,8,16,...) should be favored to be conformant with the
baseline GeoPackage specification. Use of other overview factors will work with the GDAL
driver, and cause the <a href="http://www.geopackage.org/spec/#extension_zoom_other_intervals">
gpkg.zoom_other</a> extension to be registered, but
that could potentially cause interoperability problems with other
implementations that do not support that extension.

Overviews can also be cleared with the -clean option of gdaladdo (or
BuildOverviews() with nOverviews=0)

<h2>Metadata</h2>

GDAL uses the standardized <a href="http://www.geopackage.org/spec/#_metadata_table">
<code>gpkg.metadata</code></a> and <a href="http://www.geopackage.org/spec/#_metadata_reference_table">
<code>gpkg.metadata_reference</code></a> tables to read and write metadata.

GDAL metadata, from the default metadata domain and possibly other metadata
domains, is serialized in a single XML document, conformant with the format used
in GDAL PAM (Persistent Auxiliary Metadata) .aux.xml files, and registered with
md_scope=dataset and md_standard_uri=http://gdal.org in gpkg.metadata. In
gpkg.metadata_reference, this entry is referenced with a reference_scope=table and
table_name={name of the raster table}

It is possible to read and write metadata that applies to the global DB2,
and not only to the raster table, by using the GEOPACKAGE metadata
domain.

Metadata not originating from GDAL can be read by the driver and will be
exposed as metadata items with keys of the form gpkg.METADATA_ITEM_XXX and
values the content of the metadata columns of the gpkg.metadata table.
Update of such metadata is not currently supported through GDAL interfaces (
although it can be through direct SQL commands).

The specific DESCRIPTION and IDENTIFIER metadata item of the default metadata
domain can be used in read/write to read from/update the corresponding columns of
the gpkg.contents table.

<h2>Examples</h2>

<ul>
<li>
Simple translation of a GeoTIFF into DB2. The table 'byte' will
be created with the tiles.
<pre>
% gdal_translate -of DB2ODBC byte.tif DB2ODBC:database=sample;DSN=SAMPLE
</pre>
</li>

<li>
Translation of a GeoTIFF into DB2 using WebP tiles
<pre>
% gdal_translate -of DB2ODBC byte.tif DB2ODBC:database=sample;DSN=SAMPLE -co TILE_FORMAT=WEBP
</pre>
</li>

<li>
Translation of a GeoTIFF into DB2 using GoogleMapsCompatible tiling scheme
(with reprojection and resampling if needed)
<pre>
% gdal_translate -of DB2ODBC byte.tif DB2ODBC:database=sample;DSN=SAMPLE -co TILING_SCHEME=GoogleMapsCompatible
</pre>
</li>

<li>
Building of overviews of an existing DB2
<pre>
% gdaladdo -oo RASTER_TABLE=world -r cubic DB2ODBC:database=sample;DSN=SAMPLE 2 4 8 16 32 64
</pre>
</li>

<li>
Addition of a new subdataset to an existing DB2, and choose a non
default name for the raster table.
<pre>
% gdal_translate -of DB2ODBC new.tif DB2ODBC:database=sample;DSN=SAMPLE -co APPEND_SUBDATASET=YES -co RASTER_TABLE=new_table
</pre>
</li>

<li>
Reprojection of an input dataset to DB2
<pre>
% gdalwarp -of DB2ODBC -co RASTER_TABLE=new_table in.tif DB2ODBC:database=sample;DSN=SAMPLE -t_srs EPSG:3857
</pre>
</li>

<li>
Open a specific raster table in a DB2
<pre>
% gdalinfo DB2ODBC:database=sample;DSN=SAMPLE -oo TABLE=a_table
</pre>
</li>

</ul>

<ul>
<li> <a href="drv_db2.html">DB2 vector</a> documentation page</li>
<li> <a href="frmt_various.html#PNG">PNG driver</a> documentation page</li>
<li> <a href="frmt_jpeg.html">JPEG driver</a> documentation page</li>
<li> <a href="frmt_webp.html">WEBP driver</a> documentation page</li>
<li> <a href="http://portal.opengeospatial.org/files/?artifact_id=35326">OGC 07-057r7 WMTS 1.0</a> specification</li>
<li> <a href="http://wiki.osgeo.org/wiki/Tile_Map_Service_Specification">OSGeo TMS (Tile Map Service)</a> specification</li>
</ul>

</body>
</html>