Dear Sir or Madam,
I am a PhD student at the Institute of Geodesy and Cartography in
Warsaw, Poland. In my research, I use, among others, data from Membach
station (network: BE, station code: MEM, channel: HHZ). I downloaded
data at the beginning of 2019 via ObsPy Mass Downloader
(https://docs.obspy.org/packages/autogen/obspy.clients.fdsn.mass_downloader.html)
and a few days ago again and was rather confused because of the big
differences between downloaded data sets.
Below is a list of gaps and overlaps respectively for dataset downloaded
in February 2019 and in September 2020. I would like to ask what the
following differences may result from. Could this be due to problems
with the Python toolbox, or is there another reason such as updating the
data by the station operator?
The data set downloaded on 28th February 2019:
Source Last Sample Next Sample
Delta Samples
BE.MEM..HHZ 2018-01-31T23:59:58.998393Z
2018-02-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-02-28T23:59:58.998393Z
2018-03-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-03-31T23:59:58.998393Z
2018-04-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-04-30T23:59:58.998393Z
2018-05-01T00:00:00.008391Z 0.999998 100
BE.MEM..HHZ 2018-05-20T14:42:58.958391Z
2018-05-20T14:42:59.968393Z 1.000002 100
BE.MEM..HHZ 2018-05-31T23:59:58.998393Z
2018-06-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-06-30T23:59:58.998393Z
2018-07-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-07-18T03:10:52.958393Z
2018-07-19T06:43:40.968394Z 99168.000001 9916800
BE.MEM..HHZ 2018-07-23T09:54:48.958394Z
2018-07-24T04:37:23.968393Z 67354.999999 6735500
BE.MEM..HHZ 2018-07-31T23:59:58.998393Z
2018-08-01T00:00:00.008391Z 0.999998 100
BE.MEM..HHZ 2018-08-31T23:59:58.998391Z
2018-09-01T00:00:00.008393Z 1.000002 100
BE.MEM..HHZ 2018-09-30T23:59:58.998393Z
2018-10-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-10-31T23:59:58.998393Z
2018-11-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-11-30T23:59:58.998393Z
2018-12-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-12-13T07:30:57.958393Z
2018-12-13T07:36:23.968394Z 326.000001 32600
Total: 15 gap(s) and 0 overlap(s)
The data set downloaded on 8th September 2020:
Source Last Sample Next Sample
Delta Samples
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z
2018-01-28T08:56:32.718393Z 53714.860000 5371486
BE.MEM..HHZ 2018-02-01T00:00:00.528393Z
2018-01-31T23:59:54.288393Z -6.250000 -625
BE.MEM..HHZ 2018-03-01T00:00:00.298393Z
2018-02-28T23:59:54.038393Z -6.270000 -627
BE.MEM..HHZ 2018-03-27T10:47:11.928393Z
2018-03-27T19:53:03.098393Z 32751.160000 3275116
BE.MEM..HHZ 2018-04-01T00:00:02.438393Z
2018-03-31T23:59:55.658393Z -6.790000 -679
BE.MEM..HHZ 2018-05-01T00:00:02.958393Z
2018-04-30T23:59:56.828391Z -6.140002 -614
BE.MEM..HHZ 2018-05-15T10:53:16.548391Z
2018-05-15T10:55:46.618393Z 150.060002 15006
BE.MEM..HHZ 2018-05-20T14:42:58.958393Z
2018-05-20T14:42:59.968393Z 1.000000 100
BE.MEM..HHZ 2018-06-01T00:00:02.658393Z
2018-05-31T23:59:55.808393Z -6.860000 -686
BE.MEM..HHZ 2018-07-01T00:00:02.148393Z
2018-06-30T23:59:55.508393Z -6.650000 -665
BE.MEM..HHZ 2018-07-18T03:10:52.958393Z
2018-07-19T06:43:40.968394Z 99168.000001 9916800
BE.MEM..HHZ 2018-07-23T09:54:48.958394Z
2018-07-24T04:37:23.968393Z 67354.999999 6735500
BE.MEM..HHZ 2018-08-01T00:00:06.788393Z
2018-07-31T23:59:59.948391Z -6.850002 -685
BE.MEM..HHZ 2018-09-01T00:00:01.658391Z
2018-08-31T23:59:54.808393Z -6.859998 -686
BE.MEM..HHZ 2018-10-01T00:00:05.578393Z
2018-09-30T23:59:58.858393Z -6.730000 -673
BE.MEM..HHZ 2018-11-01T00:00:00.028393Z
2018-10-31T23:59:53.458393Z -6.580000 -658
BE.MEM..HHZ 2018-12-01T00:00:00.078393Z
2018-11-30T23:59:53.628393Z -6.460000 -646
BE.MEM..HHZ 2018-12-13T07:30:57.958393Z
2018-12-13T07:36:23.968394Z 326.000001 32600
Total: 7 gap(s) and 11 overlap(s)
Kindly regards,
Kamila Karkowska
I am a PhD student at the Institute of Geodesy and Cartography in
Warsaw, Poland. In my research, I use, among others, data from Membach
station (network: BE, station code: MEM, channel: HHZ). I downloaded
data at the beginning of 2019 via ObsPy Mass Downloader
(https://docs.obspy.org/packages/autogen/obspy.clients.fdsn.mass_downloader.html)
and a few days ago again and was rather confused because of the big
differences between downloaded data sets.
Below is a list of gaps and overlaps respectively for dataset downloaded
in February 2019 and in September 2020. I would like to ask what the
following differences may result from. Could this be due to problems
with the Python toolbox, or is there another reason such as updating the
data by the station operator?
The data set downloaded on 28th February 2019:
Source Last Sample Next Sample
Delta Samples
BE.MEM..HHZ 2018-01-31T23:59:58.998393Z
2018-02-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-02-28T23:59:58.998393Z
2018-03-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-03-31T23:59:58.998393Z
2018-04-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-04-30T23:59:58.998393Z
2018-05-01T00:00:00.008391Z 0.999998 100
BE.MEM..HHZ 2018-05-20T14:42:58.958391Z
2018-05-20T14:42:59.968393Z 1.000002 100
BE.MEM..HHZ 2018-05-31T23:59:58.998393Z
2018-06-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-06-30T23:59:58.998393Z
2018-07-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-07-18T03:10:52.958393Z
2018-07-19T06:43:40.968394Z 99168.000001 9916800
BE.MEM..HHZ 2018-07-23T09:54:48.958394Z
2018-07-24T04:37:23.968393Z 67354.999999 6735500
BE.MEM..HHZ 2018-07-31T23:59:58.998393Z
2018-08-01T00:00:00.008391Z 0.999998 100
BE.MEM..HHZ 2018-08-31T23:59:58.998391Z
2018-09-01T00:00:00.008393Z 1.000002 100
BE.MEM..HHZ 2018-09-30T23:59:58.998393Z
2018-10-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-10-31T23:59:58.998393Z
2018-11-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-11-30T23:59:58.998393Z
2018-12-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-12-13T07:30:57.958393Z
2018-12-13T07:36:23.968394Z 326.000001 32600
Total: 15 gap(s) and 0 overlap(s)
The data set downloaded on 8th September 2020:
Source Last Sample Next Sample
Delta Samples
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z
2018-01-28T08:56:32.718393Z 53714.860000 5371486
BE.MEM..HHZ 2018-02-01T00:00:00.528393Z
2018-01-31T23:59:54.288393Z -6.250000 -625
BE.MEM..HHZ 2018-03-01T00:00:00.298393Z
2018-02-28T23:59:54.038393Z -6.270000 -627
BE.MEM..HHZ 2018-03-27T10:47:11.928393Z
2018-03-27T19:53:03.098393Z 32751.160000 3275116
BE.MEM..HHZ 2018-04-01T00:00:02.438393Z
2018-03-31T23:59:55.658393Z -6.790000 -679
BE.MEM..HHZ 2018-05-01T00:00:02.958393Z
2018-04-30T23:59:56.828391Z -6.140002 -614
BE.MEM..HHZ 2018-05-15T10:53:16.548391Z
2018-05-15T10:55:46.618393Z 150.060002 15006
BE.MEM..HHZ 2018-05-20T14:42:58.958393Z
2018-05-20T14:42:59.968393Z 1.000000 100
BE.MEM..HHZ 2018-06-01T00:00:02.658393Z
2018-05-31T23:59:55.808393Z -6.860000 -686
BE.MEM..HHZ 2018-07-01T00:00:02.148393Z
2018-06-30T23:59:55.508393Z -6.650000 -665
BE.MEM..HHZ 2018-07-18T03:10:52.958393Z
2018-07-19T06:43:40.968394Z 99168.000001 9916800
BE.MEM..HHZ 2018-07-23T09:54:48.958394Z
2018-07-24T04:37:23.968393Z 67354.999999 6735500
BE.MEM..HHZ 2018-08-01T00:00:06.788393Z
2018-07-31T23:59:59.948391Z -6.850002 -685
BE.MEM..HHZ 2018-09-01T00:00:01.658391Z
2018-08-31T23:59:54.808393Z -6.859998 -686
BE.MEM..HHZ 2018-10-01T00:00:05.578393Z
2018-09-30T23:59:58.858393Z -6.730000 -673
BE.MEM..HHZ 2018-11-01T00:00:00.028393Z
2018-10-31T23:59:53.458393Z -6.580000 -658
BE.MEM..HHZ 2018-12-01T00:00:00.078393Z
2018-11-30T23:59:53.628393Z -6.460000 -646
BE.MEM..HHZ 2018-12-13T07:30:57.958393Z
2018-12-13T07:36:23.968394Z 326.000001 32600
Total: 7 gap(s) and 11 overlap(s)
Kindly regards,
Kamila Karkowska
-
Dear Kamila Karkowska,
The mass downloader of ObsPy supports data collection from many data centers supporting FDSN web services.
Without any details of how you made these requests it is unclear if you collected either the first or second data
collection from the IRIS DMC or some other data center. For example, the BE_MEM data are available from both
the IRIS DMC and the ORFEUS data center (and possibly other data centers).
So it is possible the data have been updated by the operator, or there are different data holdings at different
data centers, or there is an error. It is quite difficult to tell.
Do you have any details about from which data center the data were retrieved?
To better understand how ObsPy's mass downloader is choosing data sources, it might also be useful to ask
your question to the ObsPy project via their discourse at:
https://discourse.obspy.org/
regards,
Chad
On Sep 10, 2020, at 10:48 PM, Kamila Karkowska (via IRIS) <data-issues-9169.65195-bounce<at>lists.ds.iris.edu> wrote:
Dear Sir or Madam,
I am a PhD student at the Institute of Geodesy and Cartography in
Warsaw, Poland. In my research, I use, among others, data from Membach
station (network: BE, station code: MEM, channel: HHZ). I downloaded
data at the beginning of 2019 via ObsPy Mass Downloader
(https://docs.obspy.org/packages/autogen/obspy.clients.fdsn.mass_downloader.html)
and a few days ago again and was rather confused because of the big
differences between downloaded data sets.
Below is a list of gaps and overlaps respectively for dataset downloaded
in February 2019 and in September 2020. I would like to ask what the
following differences may result from. Could this be due to problems
with the Python toolbox, or is there another reason such as updating the
data by the station operator?
The data set downloaded on 28th February 2019:
Source Last Sample Next Sample
Delta Samples
BE.MEM..HHZ 2018-01-31T23:59:58.998393Z
2018-02-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-02-28T23:59:58.998393Z
2018-03-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-03-31T23:59:58.998393Z
2018-04-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-04-30T23:59:58.998393Z
2018-05-01T00:00:00.008391Z 0.999998 100
BE.MEM..HHZ 2018-05-20T14:42:58.958391Z
2018-05-20T14:42:59.968393Z 1.000002 100
BE.MEM..HHZ 2018-05-31T23:59:58.998393Z
2018-06-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-06-30T23:59:58.998393Z
2018-07-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-07-18T03:10:52.958393Z
2018-07-19T06:43:40.968394Z 99168.000001 9916800
BE.MEM..HHZ 2018-07-23T09:54:48.958394Z
2018-07-24T04:37:23.968393Z 67354.999999 6735500
BE.MEM..HHZ 2018-07-31T23:59:58.998393Z
2018-08-01T00:00:00.008391Z 0.999998 100
BE.MEM..HHZ 2018-08-31T23:59:58.998391Z
2018-09-01T00:00:00.008393Z 1.000002 100
BE.MEM..HHZ 2018-09-30T23:59:58.998393Z
2018-10-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-10-31T23:59:58.998393Z
2018-11-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-11-30T23:59:58.998393Z
2018-12-01T00:00:00.008393Z 1.000000 100
BE.MEM..HHZ 2018-12-13T07:30:57.958393Z
2018-12-13T07:36:23.968394Z 326.000001 32600
Total: 15 gap(s) and 0 overlap(s)
The data set downloaded on 8th September 2020:
Source Last Sample Next Sample
Delta Samples
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z
2018-01-28T08:56:32.718393Z 53714.860000 5371486
BE.MEM..HHZ 2018-02-01T00:00:00.528393Z
2018-01-31T23:59:54.288393Z -6.250000 -625
BE.MEM..HHZ 2018-03-01T00:00:00.298393Z
2018-02-28T23:59:54.038393Z -6.270000 -627
BE.MEM..HHZ 2018-03-27T10:47:11.928393Z
2018-03-27T19:53:03.098393Z 32751.160000 3275116
BE.MEM..HHZ 2018-04-01T00:00:02.438393Z
2018-03-31T23:59:55.658393Z -6.790000 -679
BE.MEM..HHZ 2018-05-01T00:00:02.958393Z
2018-04-30T23:59:56.828391Z -6.140002 -614
BE.MEM..HHZ 2018-05-15T10:53:16.548391Z
2018-05-15T10:55:46.618393Z 150.060002 15006
BE.MEM..HHZ 2018-05-20T14:42:58.958393Z
2018-05-20T14:42:59.968393Z 1.000000 100
BE.MEM..HHZ 2018-06-01T00:00:02.658393Z
2018-05-31T23:59:55.808393Z -6.860000 -686
BE.MEM..HHZ 2018-07-01T00:00:02.148393Z
2018-06-30T23:59:55.508393Z -6.650000 -665
BE.MEM..HHZ 2018-07-18T03:10:52.958393Z
2018-07-19T06:43:40.968394Z 99168.000001 9916800
BE.MEM..HHZ 2018-07-23T09:54:48.958394Z
2018-07-24T04:37:23.968393Z 67354.999999 6735500
BE.MEM..HHZ 2018-08-01T00:00:06.788393Z
2018-07-31T23:59:59.948391Z -6.850002 -685
BE.MEM..HHZ 2018-09-01T00:00:01.658391Z
2018-08-31T23:59:54.808393Z -6.859998 -686
BE.MEM..HHZ 2018-10-01T00:00:05.578393Z
2018-09-30T23:59:58.858393Z -6.730000 -673
BE.MEM..HHZ 2018-11-01T00:00:00.028393Z
2018-10-31T23:59:53.458393Z -6.580000 -658
BE.MEM..HHZ 2018-12-01T00:00:00.078393Z
2018-11-30T23:59:53.628393Z -6.460000 -646
BE.MEM..HHZ 2018-12-13T07:30:57.958393Z
2018-12-13T07:36:23.968394Z 326.000001 32600
Total: 7 gap(s) and 11 overlap(s)
Kindly regards,
Kamila Karkowska
----------------------
Data Issues
Topic home: http://ds.iris.edu/message-center/topic/data-issues/ | Unsubscribe: data-issues-unsubscribe<at>lists.ds.iris.edu
Sent from the IRIS Message Center (http://ds.iris.edu/message-center/)
Update subscription preferences at http://ds.iris.edu/account/profile/
-
Dear Chad,
What do you mean by the first or second data collection?
I used the mass data downloader of ObsPy because I need to download data from different stations, and I wanted to automatic the process. The BE_MEM data was downloaded from ORFEUS data centre (both in 2018 and now). What additional information may I give?
mdl = MassDownloader() <- here in my code I didn't have any provider, because I want to check all data centres, but now I think it wasn't a good idea. Now I consider adding providers: mdl = MassDownloader(providers=["IRIS"]).
Thank you for your advice, I downloaded data from the same period from both IRIS CMC and also the ORPHEUS data centre, and it seems that there are differences between the data, as I showed below:
from obspy.clients.fdsn import Client
client = Client("IRIS")
client2 = Client("ORFEUS")
from obspy import UTCDateTime
t = UTCDateTime("2018-01-27T00:00:00.000")
t2 = UTCDateTime("2018-01-28T23:59:59.999")
st = client.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st.print_gaps()
Total: 0 gap(s) and 0 overlap(s)
st2 = client2.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st2.print_gaps()
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z 2018-01-28T08:56:32.718393Z 53714.860000 5371486
Total: 1 gap(s) and 0 overlap(s)
And now I will download BE_MEM data once again from IRIS.
Unfortunately, I'm not sure if this will help with my problem, because in my research I use also data from II_BFO. Here I have the same problem. For BFO, I downloaded all data from IRIS DCM, but there are also several differences between data downloaded now and at the beginning of 2018. Maybe I should contact the data provider and ask about updating the data sets.
Regards,
Kamila
-
Dear Chad,
What do you mean by the first or second data collection?
I used the mass data downloader of ObsPy because I need to download data from different stations, and I wanted to automatic the process. The BE_MEM data was downloaded from ORFEUS data centre. What additional information may I give?
mdl = MassDownloader() <- here I didn't have any provider in my code, because I want to check all data centres, but now I think it wasn't a good idea. I consider adding a provider: mdl = MassDownloader(providers=["IRIS"])
Thank you for your advice, now I downloaded data from the same period from both IRIS CMC and also the ORPHEUS data centre, and it seems that there are differences between the data.
from obspy.clients.fdsn import Client
client = Client("IRIS")
client2 = Client("ORFEUS")
from obspy import UTCDateTime
t = UTCDateTime("2018-01-27T00:00:00.000")
t2 = UTCDateTime("2018-01-28T23:59:59.999")
st = client.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st.print_gaps()
Total: 0 gap(s) and 0 overlap(s)
st2 = client2.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st2.print_gaps()
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z 2018-01-28T08:56:32.718393Z 53714.860000 5371486
Total: 1 gap(s) and 0 overlap(s)
So, I will download the BE_MEM data from IRIS DCM.
Unfortunately, I am not sure if this will help with my problem as I also use data from II_BFO in my research. I have the same problem here. For BFO, I downloaded all the data from IRIS DCM, and there are also a few differences between the data I downloaded now and early 2018. Probably, I should contact the data provider, maybe it will help and I will find out if data updates have been made.
Thank you so much for your help.
Regards,
Kamila
-
Hi Kamila-
What I noticed from your sample scan output from the 2018 data compared to recent is that it looks like the older data had time breaks at the day boundary that resulted in a small backward shift.
end of last trace start of next trace
BE.MEM..HHZ 2018-02-01T00:00:00.528393Z 2018-01-31T23:59:54.288393Z -6.250000 -625
BE.MEM..HHZ 2018-03-01T00:00:00.298393Z 2018-02-28T23:59:54.038393Z -6.270000 -627
We have largely solved these problems at the DMC (for some time now) since we instituted the archiving of 'merged' data that handles these overlaps. It is also possible that the time shifts were due to clock drift that was not corrected. As Chad indicates, we cannot tell where you received the old data versus the new data (IRIS or ORFEUS), but your newer data definitely looks better, as most of your gaps in the data are just one sample and the time shifts forward.
We do perform corrections and replacements of data from time to time but we currently do not keep online records of such data changes (no versioning). We do track metadata changes, but that's not the issue we're dealing with here.
-Rob
On Sep 11, 2020, at 1:14 AM, Kamila Karkowska (via IRIS) <data-issues-9172.63244-bounce<at>lists.ds.iris.edu> wrote:
Dear Chad,
What do you mean by the first or second data collection?
I used the mass data downloader of ObsPy because I need to download data from different stations, and I wanted to automatic the process. The BE_MEM data was downloaded from ORFEUS data centre. What additional information may I give?
mdl = MassDownloader() <- here I didn't have any provider in my code, because I want to check all data centres, but now I think it wasn't a good idea. I consider adding a provider: mdl = MassDownloader(providers=["IRIS"])
Thank you for your advice, now I downloaded data from the same period from both IRIS CMC and also the ORPHEUS data centre, and it seems that there are differences between the data.
from obspy.clients.fdsn import Client
client = Client("IRIS")
client2 = Client("ORFEUS")
from obspy import UTCDateTime
t = UTCDateTime("2018-01-27T00:00:00.000")
t2 = UTCDateTime("2018-01-28T23:59:59.999")
st = client.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st.print_gaps()
Total: 0 gap(s) and 0 overlap(s)
st2 = client2.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st2.print_gaps()
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z 2018-01-28T08:56:32.718393Z 53714.860000 5371486
Total: 1 gap(s) and 0 overlap(s)
So, I will download the BE_MEM data from IRIS DCM.
Unfortunately, I am not sure if this will help with my problem as I also use data from II_BFO in my research. I have the same problem here. For BFO, I downloaded all the data from IRIS DCM, and there are also a few differences between the data I downloaded now and early 2018. Probably, I should contact the data provider, maybe it will help and I will find out if data updates have been made.
Thank you so much for your help.
Regards,
Kamila
----------------------
Data Issues
Topic home: http://ds.iris.edu/message-center/topic/data-issues/ | Unsubscribe: data-issues-unsubscribe<at>lists.ds.iris.edu
Sent from the IRIS Message Center (http://ds.iris.edu/message-center/)
Update subscription preferences at http://ds.iris.edu/account/profile/
-
Dear Kamila,
It's unfortunate to find differences in data set holdings between data centers. While we don't expect it often it does happen.
Regarding II_BFO, the IRIS DMC is the primary data center for that station and you should get the best data from the DMC.
regards,
Chad
On Sep 11, 2020, at 1:14 AM, Kamila Karkowska (via IRIS) <data-issues-9172.63244-bounce<at>lists.ds.iris.edu> wrote:
Dear Chad,
What do you mean by the first or second data collection?
I used the mass data downloader of ObsPy because I need to download data from different stations, and I wanted to automatic the process. The BE_MEM data was downloaded from ORFEUS data centre. What additional information may I give?
mdl = MassDownloader() <- here I didn't have any provider in my code, because I want to check all data centres, but now I think it wasn't a good idea. I consider adding a provider: mdl = MassDownloader(providers=["IRIS"])
Thank you for your advice, now I downloaded data from the same period from both IRIS CMC and also the ORPHEUS data centre, and it seems that there are differences between the data.
from obspy.clients.fdsn import Client
client = Client("IRIS")
client2 = Client("ORFEUS")
from obspy import UTCDateTime
t = UTCDateTime("2018-01-27T00:00:00.000")
t2 = UTCDateTime("2018-01-28T23:59:59.999")
st = client.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st.print_gaps()
Total: 0 gap(s) and 0 overlap(s)
st2 = client2.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st2.print_gaps()
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z 2018-01-28T08:56:32.718393Z 53714.860000 5371486
Total: 1 gap(s) and 0 overlap(s)
So, I will download the BE_MEM data from IRIS DCM.
Unfortunately, I am not sure if this will help with my problem as I also use data from II_BFO in my research. I have the same problem here. For BFO, I downloaded all the data from IRIS DCM, and there are also a few differences between the data I downloaded now and early 2018. Probably, I should contact the data provider, maybe it will help and I will find out if data updates have been made.
Thank you so much for your help.
Regards,
Kamila
----------------------
Data Issues
Topic home: http://ds.iris.edu/message-center/topic/data-issues/ | Unsubscribe: data-issues-unsubscribe<at>lists.ds.iris.edu
Sent from the IRIS Message Center (http://ds.iris.edu/message-center/)
Update subscription preferences at http://ds.iris.edu/account/profile/
-
Dear Kamila,
I should also mention the IRIS Federator service: http://service.iris.edu/irisws/fedcatalog/1/
This system allows you to search for data across FDSN data centers and, importantly, matches data requests with their primary data center.
As an alternative to ObsPy's Mass Downloader, you can use our Federator via ObsPy's RoutingClient support:
https://docs.obspy.org/packages/obspy.clients.fdsn.html#basic-routing-clients-usage
regards,
Chad
On Sep 11, 2020, at 10:56 AM, Chad Trabant <chad<at>iris.washington.edu> wrote:
Dear Kamila,
It's unfortunate to find differences in data set holdings between data centers. While we don't expect it often it does happen.
Regarding II_BFO, the IRIS DMC is the primary data center for that station and you should get the best data from the DMC.
regards,
Chad
On Sep 11, 2020, at 1:14 AM, Kamila Karkowska (via IRIS) <data-issues-9172.63244-bounce<at>lists.ds.iris.edu> wrote:
Dear Chad,
What do you mean by the first or second data collection?
I used the mass data downloader of ObsPy because I need to download data from different stations, and I wanted to automatic the process. The BE_MEM data was downloaded from ORFEUS data centre. What additional information may I give?
mdl = MassDownloader() <- here I didn't have any provider in my code, because I want to check all data centres, but now I think it wasn't a good idea. I consider adding a provider: mdl = MassDownloader(providers=["IRIS"])
Thank you for your advice, now I downloaded data from the same period from both IRIS CMC and also the ORPHEUS data centre, and it seems that there are differences between the data.
from obspy.clients.fdsn import Client
client = Client("IRIS")
client2 = Client("ORFEUS")
from obspy import UTCDateTime
t = UTCDateTime("2018-01-27T00:00:00.000")
t2 = UTCDateTime("2018-01-28T23:59:59.999")
st = client.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st.print_gaps()
Total: 0 gap(s) and 0 overlap(s)
st2 = client2.get_waveforms("BE", "MEM", "*", "HHZ", t, t2)
st2.print_gaps()
BE.MEM..HHZ 2018-01-27T18:01:17.848393Z 2018-01-28T08:56:32.718393Z 53714.860000 5371486
Total: 1 gap(s) and 0 overlap(s)
So, I will download the BE_MEM data from IRIS DCM.
Unfortunately, I am not sure if this will help with my problem as I also use data from II_BFO in my research. I have the same problem here. For BFO, I downloaded all the data from IRIS DCM, and there are also a few differences between the data I downloaded now and early 2018. Probably, I should contact the data provider, maybe it will help and I will find out if data updates have been made.
Thank you so much for your help.
Regards,
Kamila
----------------------
Data Issues
Topic home: http://ds.iris.edu/message-center/topic/data-issues/ | Unsubscribe: data-issues-unsubscribe<at>lists.ds.iris.edu
Sent from the IRIS Message Center (http://ds.iris.edu/message-center/)
Update subscription preferences at http://ds.iris.edu/account/profile/
-
Dear Chad and Rob,
thank you for the answer and tips. Is it possible for an issue to be closed?
Regards,
Kamila
-
Hi Kamila-
This is a mailing list and not an issue tracker, so there is nothing to close, per se. Just acknowledgement that you received the help you need is enough.
Regards,
-Rob
On Sep 14, 2020, at 5:12 AM, Kamila Karkowska (via IRIS) <data-issues-9180.88241-bounce<at>lists.ds.iris.edu> wrote:
Dear Chad and Rob,
thank you for the answer and tips. Is it possible for an issue to be closed?
Regards,
Kamila
----------------------
Data Issues
Topic home: http://ds.iris.edu/message-center/topic/data-issues/ | Unsubscribe: data-issues-unsubscribe<at>lists.ds.iris.edu
Sent from the IRIS Message Center (http://ds.iris.edu/message-center/)
Update subscription preferences at http://ds.iris.edu/account/profile/
-
-
-
-
-