Scheduling WaterML Dataset Extracts

You can schedule regular dataset extracts and transfers. The WaterML Datasets module provides more scheduling flexibility than the WDTF Datasets module.

Setting start and end dates

You can enter specific dates and times in the Start Date or the End Date fields, or you can leave one or both of the fields blank to use the default start or end date.

  • The default start date is at the end date of the last Transferred extract. A transferred extract is one that was successfully sent to the configured recipient. View completed extracts and their statuses in the Extracts Module.
  • The default end date is the current date and time.

If you leave both the start and end dates blank, the WaterML extraction schedule behaves in the same way as the WDTF extraction schedule.

If the start date is blank, when does the first extract start?

If you set up a recurring extract and leave the start date blank, the first extract will include the earliest data in your source database. If you want to omit older data, or start the first extract at a specific time then continue with regular extracts, run the first extract manually to set the start date for the rest of the series. See Generating WaterML Dataset Extracts for more details.

What happens to modified data from earlier extract periods?

If you do not specify a start date, the extract will include both new data collected since the end of the last export, and any older data that has been modified since that time.

If you do specify a start date, the extract will include only data that was collected in the specified period. Any older data, whether or not it has been recently modified, will not be included.

Incrementing the start or end dates

If either the start or end date is set manually, you should set the Increment date parameters each run checkbox to change the dates every time the extract is run. Any fixed dates are incremented by the recurrence interval.

Example:

If the recurrence interval is one month, the specified dates are increased by one month every time the extract is run.

Example

If the recurrence interval is one month, the specified dates are increased by one month every time the extract is run.

If you do not increment the date parameters, the same fixed date will be used for every extract.

Caution

If you specify both the start and end dates, and do not increment the date parameters, every extract will contain the identical set of data.

To schedule WaterML dataset extracts:

  1. Click WaterML Datasets to open the WaterML Datasets module.
  2. Select the dataset from which you want to extract data.
  3. Click Generate/Schedule WaterML Dataset Extract and complete the extract details. See Generating WaterML Dataset Extracts for more information.

    Give the Start Date and End Date of the first extract, or leave either of the date fields blank to use the defaults.

  4. Click Schedule and complete the following details:
    PropertyDescription

    Description

    Enter a description for the scheduled extract. This will help you to identify the job in the Scheduled Reports and Tasks module.

    Start date/time

    Enter the date and time when you want the extractions to start.

    Note that this is not the starting date for the extracted data. You specify the dates for the extraction in the WaterML Extract screen.

    Recurring

    Select this checkbox to make regular extractions and set the extraction interval.

    Increment date parameters each run

    Select this checkbox to increment the start and end date of the extraction each time the extraction is run. If the dates are not blank, they are incremented by the recurrence period.

    If you have provided a specific start or end date for the extraction, you should select the Increment data parameters checkbox. Otherwise the same date or dates will be used for every extract.

  5. Click Save to save your settings.