Archiving Data Sets

Data Update Utility

In the Orbit Determination Tool Kit (ODTK®) application, the Data Update Utility enables you to update astro data sets, including:

  • EOP-v1.1.txt
  • EOP-All-v1.1.txt
  • SpaceWeather-v1.2.txt
  • SpaceWeather-All-v1.2.txt
  • LeapSecond.dat
  • time.ker
  • GPSCatalog.txt
  • Ionosphere IRI2016
  • GPS_Catalog.txt
  • GPS_Catalog_IGS.txt
  • GPS_Catalog_NGA.txt
  • BeiDou_Catalog.txt
  • Galileo_Catalog.txt
  • GLONASS_Catalog.txt
  • QZSS_Catalog.txt
  • GPS_ISCDelayData.txt
  • QZSS_ISCDelayData.txt
  • ap.dat

You can manually update one or more data sets, or you can schedule a time and frequency for automatic updates.

The utility does not use file find paths. Do not attempt to change the location from the default location.

Space weather sources

The following table lists the sources for space weather data that AGI uses to populate its data files.

Source Description
https://services.swpc.noaa.gov/text/3-day-solar-geomag-predictions.txt Provides k indices and solar flux predictions for the current day and the following two days.
https://services.swpc.noaa.gov/text/45-day-ap-forecast.txt Provides k indices and solar flux predictions for the current day and the following 44 days.
https://chain-new.chain-project.net/echaim_downloads/ig_rz.dat This file is updated infrequently. When it is updated, AGI adds it to the files associated with the currently applied IRI model. The documentation associated with these data is at https://irimodel.org/indices/IRI-Format-indices-files.pdf.
https://testbed.swpc.noaa.gov/products/solar-cycle-progression-updated-prediction-experimental The data update server uses the latest predicted-solar-cycle.json (linked in this web page) to obtain long-term predictions of solar flux and sunspot number for the remainder of the current solar cycle.
https://www.nasa.gov/solar-cycle-progression-and-forecast This is the source of Marshall Mean Cycle data for the solar cycle following the current cycle produced by the Marshall Space Flight Center. This data set is repeated to provide a notional representation of the next several solar cycles. Solar cycles beyond the current cycle cannot be accurately predicted, so this portion of the space weather prediction file should be regarded as notional only and not a true prediction of future conditions. The Data Update Server uses the latest sunspot number and solar radio flux files linked on this page to gather sunspot number, Ap, and solar flux values for its notional representation of future solar cycles.
https://www-app3.gfz-potsdam.de/kp_index/Kp_ap_Ap_SN_F107_since_1932.txt Provides historical observed space weather data from 1932 through the present day.

Running the utility

To run the utility, select Data Update... from the Utilities menu.

The Data Update screen contains three tabs:

  • Astro Data enables you to configure automatic updates or perform a manual update of astro data.
  • History enables you to review the activity of automatic Astro Data updates.
  • Connection enables you to download updates through a proxy server.

Astro data

To configure automatic updates or perform a manual update, select the Astro Data tab. The grid shows the available Astro data sets, the date of AGI’s latest version, and the version that is on the local computer.

Manual updates

To manually download updates for Astro data sets:

  1. For each data set that you want to update, select the Update check box or select the Check All check box to update all data sets.
  2. To store previous versions of a data set when a new version is downloaded, select the Archive check box. For more information, see Archiving Data Sets.
  3. Click Update Now to download the updates.

The display will automatically refresh, showing the new versions on the local computer.

The color of the data set indicates its current status:

  • Red data sets have updates available.
  • Black data sets are up to date.
  • Purple data sets are not currently available on AGI servers.

You must have local administrator rights or at least write access to the folders where the data sets are located.

Automatic updates

To configure automatic updates:

  1. Select the Enable Automatic Updates check box.
  2. For each data set that you want to automatically update, select the Auto Update check box or select the Check All check box to update all data sets.
  3. Select a setting for Frequency. Choose Daily, Weekly, or Monthly. With the exception of LeapSeconds.dat, AGI typically updates the data sets daily.
  4. Select a Scheduled Date/Time. Pick a time that the computer is likely to be turned on but when the ODTK application will not be running. If you choose a date/time which is in the past, the ODTK application will add the frequency value to that date/time to calculate the next scheduled date/time.
  5. To store previous versions of a particular data set, select the Archive check box for that data set. For more information, see Archiving Data Sets.
  6. Click OK or Apply for the changes to take effect.

Notes

  • Click Refresh to redraw the grid with the latest information from AGI servers and the local computer. If an automatic update occurs while this tab is up, it is automatically refreshed.
  • You do not have to be signed in for the updates to execute.
  • You do not need local administrator rights to have automatic updates, but you do need administrator rights to modify the update options.
  • If either the ODTK application or Systems Tool Kit® (STK®) application is running during the scheduled time, the update will occur, and an informational message is written to the history.
  • If the computer is turned off during the scheduled time, the update does not occur. The update will execute the next time the computer is on during the scheduled time. For example, if Weekly updates are scheduled for 9:00 PM and an update executed on Sunday the 14th, the next one is scheduled to run on Sunday the 21st. If the computer is off that Sunday but turned on Monday morning, the update executes at 9:00 PM on Monday, then the next update is scheduled for Monday, the 29th.

Connection

To download data sets through a proxy server, open the Connection tab and proceed as follows:

  1. Select the Use Proxy check box and specify the appropriate FTP, Server, and Port information.
  2. If your internet access is via a firewall, select the Requires Authentication check box and specify a proxy username and password. If you are unsure how your internet connection is configured, please consult your system administrator.

History

The History tab provides information about the activity of the Automatic Updates. It is useful to check this to diagnose problems, such as missing updates because the ODTK application was running.

To permanently delete the current history contents, click Delete History.

If an automatic update occurs while this tab is up, the tab is automatically refreshed.

Updating data without an internet connection

If you are running the ODTK application on a computer that is not connected to the internet, perform the following steps to update your data:

  1. Download the file DataUpdateOdtk.zip from https://ftp.agi.com/dist or https://Stk13-00-duu.agi.com/dist to another computer that is connected to the internet.
  2. Copy the ZIP file to removable media or a network resource that the unconnected computer can access.
  3. Extract the contents of the ZIP file into your ODTK program data folder, which is typically C:\ProgramData\AGI\STK_ODTK <version number>\DynamicEarthData. The ProgramData folder is often hidden by default, so you may need to alter your Windows folder options to display it.

AGI refreshes the ODTK DataUpdate ZIP file with the latest data every day at 8 am UTC.

Archiving data sets

The data set archive files are stored in the following folders:

  • EOP and stkFluGeoMag files:
    • <ODTK user area>\ODTK <version number>\DynamicEarthData\ODDataUpdate Archives
  • LeapSecond.dat files:
    • <ODTK user area>\ODTK <version number>\DynamicEarthData
  • GPS Catalog:
    • <ODTK user area>\ODTK <version number>\Databases\GNSS

The default ODTK user area is C:\Documents and Settings\All Users\Application Data\AGI\. The archived files are renamed to include the date they were created (for example, LeapSecond-7-13-2005.dat).

Archiving disk space requirements

You need to consider how much disk space is available and how often you receive updates before using the archive feature. For example, one set of archive files for EOP, stkFluGeoMag and LeapSecond.dat, requires about two megabytes of disk space.