Difference between revisions of "CSEP Test Results"

From SCECpedia
Jump to navigationJump to search
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
SCEC is developing software tools for extracting CSEP test results from the CSEP data archives.
 
SCEC is developing software tools for extracting CSEP test results from the CSEP data archives.
  
== Purpose ==
+
== Purpose Of Scripts ==
CSEP one-day-model test results are posted in a series of files, one every day of operation. We want a script that will open the daily files, extract some information, and then print it in a csv table summary form. We will develop tools working with one-day-models because those have been running the longest.
+
CSEP one-day-model test results are posted in a series of files, one every day of operation. We want a script that will open the daily files, extract some information, and then print it in a comma separated values (csv) ASCII file form. We are starting with one-day-models because those have been running the longest.
  
== SCEC-natural-laboratory/one-day-models/results N-Test Result  ==
+
== one-day-models ==
Testing center has one day model results from 2007-03-01 through 2017-03-03. These results are preliminary. The xml result file format changed during the course of the test run, and the scripts have built-in date format checks.
+
Forecast models in a forecast group use the same input catalogs, and run the same evaluation tests. The SCEC CSEP testing center has one day model results from  
*[http://hypocenter.usc.edu/research/CSEP/one-day-models-n-test.csv CSEP Test Results in csv format file (200Kb)]
+
*2007-08-01 through 2017-03-03.  
  
== Example N-Test Result Format ==
+
To support the full date range, we must handle the changes in XML result file format.
For testing dates 02 March 2010 through 04 March 2017, we can find a AllModelsSummary file. We scan the directories, and produce the csv file below, with about 2500 rows of N-test results.
+
The xml result file format changed during the course of the test run, and the scripts have to check the results date to identify which format the results are in.
  
*[http://hypocenter.usc.edu/research/CSEP/one-day-models_n-test_2010March02_2017March4.csv csv format file (200Kb)]
+
== One Month Results ==
 +
We have extracted the first week of results to confirm that the output files are properly formatted.
 +
*[http://hypocenter.usc.edu/research/CSEP/one_day_step_etas_ntest_short.csv August 2007 Week 1 ETAS and STEP results in CSV format]
  
== Format evaluation ==
+
== Ten Years Results ==
We are refining the format for the csv file.
+
We have extracted the full 10 years of results:
# Comment header with information about the report, once per file
+
*[http://hypocenter.usc.edu/research/CSEP/one_day_step_etas_ntest.csv August 2007 - March 2017 ETAS and STEP results in CSV format]
# columnHeader1,columnHeader2,columnHeader3, before any data
 
# one row of data, one for each test date:time
 
 
 
For testing dates 2016-01-01 through 2017-01-01, we generate the comma separated values (csv) file posted below.
 
*[http://hypocenter.usc.edu/research/CSEP/one-day-models_n-test_2016.csv 2016 Ntest Results]
 
  
 
== Source Codes ==
 
== Source Codes ==
*[https://github.com/SCECcode/CSEPcode CSEPcode Repository]
+
* [https://github.com/SCECcode/CSEPcode CSEP Code Repository]
  
 
== Related Entries ==
 
== Related Entries ==
 
*[[CSEP]]
 
*[[CSEP]]
 
*[[Software]]
 
*[[Software]]

Latest revision as of 01:08, 28 November 2017

SCEC is developing software tools for extracting CSEP test results from the CSEP data archives.

Purpose Of Scripts

CSEP one-day-model test results are posted in a series of files, one every day of operation. We want a script that will open the daily files, extract some information, and then print it in a comma separated values (csv) ASCII file form. We are starting with one-day-models because those have been running the longest.

one-day-models

Forecast models in a forecast group use the same input catalogs, and run the same evaluation tests. The SCEC CSEP testing center has one day model results from

  • 2007-08-01 through 2017-03-03.

To support the full date range, we must handle the changes in XML result file format. The xml result file format changed during the course of the test run, and the scripts have to check the results date to identify which format the results are in.

One Month Results

We have extracted the first week of results to confirm that the output files are properly formatted.

Ten Years Results

We have extracted the full 10 years of results:

Source Codes

Related Entries