Jump to main content or area navigation.

Contact Us

STORET/WQX: System Change Control Log

STORET Warehouse Change Log

This change log details the status of bugs and issues in the STORET Warehouse. Matters of contention that are resolved are listed as completed,while ongoing issues are listed as open.

Last Date of Change Log Update: 4/2/2013

Issue NumberTitle/DescriptionProposed Fix STORET Helpdesk Tracking #(s)Fix DateStatusReceived Date
artf10376Delete Duplicated STORETW Results
In some rare instances, Activity ID's are duplicated in the STORET Warehouse.
Delete all records that were not effectively removed before the delete strategy was implemented by the ETL.  11/14/2012Open11/12/2012
artf11534New WQX schema change request (Add Date Stamp (Analysis Date or Sampling Date) for Activity Group Fact Table))
Add Date Stamp (Analysis Date or Sampling Date) for Activity Group) Mandatory Metadata reports for ACTIVITY GROUP are filtered by organization_id Impacts warehouse schema and reports: Warehouse download delayed by ACTIVITY_GROUPS.
1. Query by Date Stamp (Analysis Date or Sampling Date) for Activity Group 2. Update warehouse application optional download for ACTIVITY_GROUPS  Open4/1/2013
artf11533"Retired" Taxon Names established data management procedures
Checking the WQX Taxon domain list ( http://www.epa.gov/storet/wqx/wqx_getdomainvalueswebservice.html), that name is on the list and it is not on the cross-walk spreadsheet from September. Checking ITIS, I see “Diatoma mesodon” is a not accepted synonym for “Diatoma hiemale”, so I assume that’s why it’s being rejected.
Send Monthly Domain Value Alerts to Listerver (User Call)  Open4/1/2013
artf11532Water Quality Portal Issue: Warehouse Station Record column STATION_GROUP_TYPE not updated in post ETL
Water Quality Portal Parameter: Site Type is NULL Queries fail to filter by Site type.
Add Post ETL checks to cross map STORET Station Types to WQP Site Types weekly.  Open4/1/2013
artf11531Placement of New columns (Actual Activity Horizontal Accuracy) in warehouse download report
- Actual Activity Lat/Long* - group currently has: o Actual Activity Latitude o Actual Activity Longitude o Actual Activity Horizontal Datum o Actual Activity Horizontal Accuracy
New warehouse column email STORET Community via Listserver Alert http://www.epa.gov/storet/download/WarehouseReport_withWQXcolumns.xls  Open4/1/2013
artf11530Failed/Imported Datasets WQX Web: FYI: WQX Web Online Video Tutorial
Failed/Imported Datasets WQX Web: WQXWEBTRAINING accounts does not match Spreadsheet Tutorial Template
Add columns to Import configurations  Open4/1/2013
artf11529Javascript request suppress non email characters: Report of pending data requests 2013/03/20
Warehouse application fails query processing when email address contains non standard characters ie commas instead of periods
suppress characters for email address field  Open4/1/2013
artf11528Analytical Proc ID does not support tilda as delimiter between ALL concatenated fields
Analytical Proc ID does not support tilda / '~' as delimiter between ALL concatenated fields (proc source ~ proc id)
ALL ETL concatenated fields must have a tilda / '~' as delimiter separating fields before storing in database column.  Open4/1/2013
artf10740Warehouse Impacted by WQX ORG_IDS change to UPPER CASE
Remove Case Sensitivity from WQX & Warehouse ORGANIZATION_ID. Difficult to capture a list of stations in the Water Quality Portal query parameters
Change all Warehouse ORGANIZATION_ID to UPPER CASE 1/15/2013Completed1/14/2013
artf10128Cleanup script for duplicate characteristics
ETL creates duplicate characteristics in Warehouse Domain Value List.
Suppress / Display distinct list of Characteristic Domain Values. Then re-assign duplicate characteristics to minimum identifier.  12/5/2012Completed10/10/2012
artf10125Warehouse Download - Revert query to FK_GEN_DB_CAT
Warehouse stations and results queries inconsistent in data counts. ETL fails to populate foreign key / query key for huc8 parameters. Warehouse application filters on generated columns. The Warehouse GENERATED Column Rule: if given a "user supplied value" exist then the GENERATED column = "user supplied value".
Fix post ETL script to populate generated foreign keys used by warehouse query parameters.  1/23/2013Completed10/10/2012
artf9756ETL truncates RESULT_VALUE_STATUS to 1 character
ETL truncates RESULT_VALUE_STATUS to 1 character
Correct ETL to populate the full RESULT_VALUE_STATUS characters (12) 9/22/2012Completed9/5/2012
artf8475Warehouse Download Enhancements - Do not clean previous selections when selection changes
Do not clear Warehouse interface query selections when a Warehouse query is modified.
artf8404Add generated state/county to the results table
Add generated state and couny fields to the STORET results table. Lat/long is the only required geographic location data in WQX submission
Populate warehouse generated state and county for accurate and consistent query parameters.  Completed4/20/2012
artf7800Data Elements Result Depth and Result Depth Unit are not available in the STORET Warehouse
Result Depth and Result Depth Unit are data elements available in WQX, but not queriable through the STORET Warehouse.
artf7672Results associated with EPA Beaches data are duplicating
EPA Beaches results data is duplicated when downloaded from the STORET Warehouse.
 1571 Completed12/1/2011
artf7448 Characteristic names are duplicated when the activity is data logger (historical results)
Data Logger results are duplicated for historical STORET data
 1292 Completed10/27/2011
artf7432Detection Limits/Upper and Lower Quantification Limit
Non detect values for characteristics are not consistently displayed out of the Warehouse.
 791, 644, 1128, 147712/21/2010Completed10/26/2011
artf7431STORET Warehouse is not returning results with result comment fields that exceed 3000 characters
Results with an extensive amount of characters in the result comment fields are not being returned from the STORET Warehouse. This issue only affects result comment fields exceeding 3900 characters.
 1477 Completed10/26/2011
artf7429Activity comment field truncation
The Activity Comment field is being truncated at 256 characters for biological results only. It should be 4000 characters.
artf7309STORET Helpdesk Ticket # 1473 Input and Output fields STORET System
a spreadsheet showing the data elements from the WQX 2.1 data dictionary and the output fields from the warehouse.
Update Warehouse, application tool and ETL for reporting WQX data elemets  Completed10/12/2011
artf7158Projects and Monitoring Locations are not being deleted out of the Warehouse.
There is currently not a way to delete projects or monitoring locations from the STORET Warehouse.
Develop scripts to mirror actions executed in WQX deleting Monitoring Locations and Projects to concurrently perform the same actions in the STORET Warehouse. 1351 Completed9/17/2011
artf7143Missing Activity Attached Documents
From the Warehouse query application, Activity Document / Graphic URLs are blank when returned in the downloaded text file.
The maximum Activity Document / Graphic unique identifier from WQX must be placed in the correct table and column within the STORET Warehouse, and the refresh process will confirm this unique ID is getting populated and the URL is populating the "Activity/Result Document Graphic" data element in the STORET Warehouse.1292, 9771/13/2012Completed9/14/2011
artf6996Activities repeated multiple times
Activity ID's are repeated multiple times for results queried from the WQX web services.
artf6730Activity Media Name field is returning incorrect values for QC submissions
WQX data submitted with Activity Types containing the phrase "Quality Control" are not being consistently stored as QC data in the STORET Warehouse.
Explore the universe of data that falls within a QC media within the STORET Warehouse. Explore alternative ways of serving out QC data in order to preserve the original activity media submitted by users. 420, 11746/1/2012Completed5/23/2011
artf6705 WQX -- STORET Warehouse issue with repeating projects
When the STORET GetResults web service is called (http://iaspub.epa.gov/webservices/StoretResultService/), the returned data file sometimes contains repeating Project IDs.
Evaluate the extent of the issue to determine if this is an issue with all GetResults service calls or only a few organizations. Make any needed revisions to the GetResults service code. 1289 Completed5/17/2011
artf6628 Activity Groups are not available out of the STORET Warehouse
Activity group is a data element available in WQX, however not out of the STORET Warehouse.
Spool a separate report for Activity Groups based on Organizations data queried.147311/21/2012Completed4/15/2011
artf6580Problems with binary attachments in WQX project files
Problems with binary attachments in WQX project files. WQX business rule many attachments can be assigned to one project. ETL to Warehouse rule of one to one project and attachment assignment. Warehouse business rule requirement one per project id.
The Metadata file Project Summary could be updated to include the URLS to download the 'PROJ Binary Object'. ETL only the last (most recent) attachment assigned to WQX project id 7/28/2012Completed4/4/2011
artf6338Alternative Monitoring Locations to Warehouse Station Alias Table
The STORET Warehouse is not serving out Alternative Monitoring Locations when queried.
artf6337Detection Limits Handling
It appears that the Warehouse is currently not able to report all detection limits associated with a result in separate columns (WQX data). For example, when data has an Upper Quantification Limit, that value is being reported in both the “Detection Limit” field as well as the “Upper Quantification Limit” field when exported from the Warehouse.
 791, 644, 1128, 147712/21/2011Completed2/16/2011
artf6279STORET Warehouse counts and EPA web services counts for Results and Stations should match
STORET Warehouse query counts and STORET web services counts for results and stations do not match. When results or stations are queried with EPA web services, counts do not match replicate queries in the STORET Warehouse query application.
artf6272Map scales for some Monitoring Locations have extra decimal places when downloaded from the STORET Warehouse
Some Monitoring Location map scales are being assigned extra decimal places when downloaded from the Warehouse.
This has been fixed.7252/28/2011Completed2/2/2011
artf6271Project Document/ Graphic and Project/ Document URL fields are not being returned from the Warehouse
From the Warehouse query application, Project Document / Graphic URLs are blank when returned in the downloaded text file.
The maximum Project Document / Graphic unique identifier from WQX must be placed in the correct table and column within the STORET Warehouse, and the refresh process will confirm this unique ID is getting populated and the URL is populating the "Project Document/Graphic" data element in the STORET Warehouse.1292, 1473, 7254/13/2011Completed2/2/2011
artf6203WQX toxicity data is improperly mapped to STORET regular results
Much of the toxicity data in WQX is getting improperly mapped to the STORET regular result fact table instead of the biological result fact table where it should be mapped to. This behavior is not consistent; the WQX data with "Count" as the characteristic is getting placed in the STORET biological result fact table, but none of the other records are.
WQX Data that flags the activity media field as biological, and/ or Biological Intent as not null, and /or Taxonomic field as not null. will now be mapped as biological results.  Completed1/19/2011
artf6027Characteristic Name is not populated when Category-Rep Num is Routine Habitat
From the Storet warehouse, the Characteristic Name field is not populated when Routine Habitat is indicated for the field Category-Rep Num. This issue only relates to distributed STORET data.

Jump to main content.